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(54) Hierarchical data display method and information processing system for realizing it 

(57) The present invention provides a time-series or a cutout can be chariged in size. 
d.4iH display nnethod for displaying time-series data 
ricms so that a user can grasp time more intuitively and 
sensuously, and an information processing system for 
realising the display method, wherein first data associ- 
ated with a desired date is retrieved and displayed, sec- 
ond data associated with a date contiguous to the de- 
sired date is retrieved, a display screen for the second 
data ts displayed with a smaller size than a display 
screen tor the first data in a temporal direction starting 
with the desired date, third data associated with a date 
contiguous to the date of the second data is retrieved, 
and the third data is displayed inside the second data 
wrth a display area thereot nnade smaller. The present 
invention also provides a hierarchical data display meth- 
od and browser system, wherein a display area is divid- 
ed into an area, in which data icons- representing data 
items belonging to one level are displayed, and an area 
in which child levels are displayed. As a hierarchical 
depth increases, the data icons are made smaller in size 
and simpler. The hierarchical structure of a file system 
or data base having a hierarchical structure can be dis- 
played in the form of a Vcnri diagram, thus making it 
possible to grasp the whole structure intuitively Data 
items belonging to child levels are not hidden but dis- 
played in the form of reduced images, whereby intended 
data can be located effortlessly A cutout form and image 
are registered mutually independently. An identifier, po- 
sition, and size of the cutout form are specified as the 
attributes of the image. Thus, an image can be fetched 
into album software by performing a simple operation. 




Printed by Jouve, 76001 PARIS (PR) 



BNSDOCID: ^EP 0717346A2J_> 



10 



IS 



20 



25 



30 



35 



40 



45 



SO 



ss 



EP 0 717 346 A2 

Description 

The present invention relates to a hierarchical data display method lor retrieving and displaying data from a data 
base, file system, or the like in which a plurality of data items are managed hierarchically, and to a browser system 

More particularly, the present invention relates to a time-series data display method for displaying a plurality of 
data rtems that are managed using associated dates, and to an information processing system for realizing the method 

The present inventbn also relates to an image editing method and system to be implemented in drawing software 
tor handing images or a data base system. 

In a file managennent system or data base system for a computer, a technique of managing data hierarchically is 
often used to manage numerous data items. In a file system, especially, under almost all operating systems (hereinafter 
OSs), the whole of the file system is segmented and managed using a plurality of hierarchical directories As far as 
recently-released OSs are concerned, it is a matter of common practice to adopt a browser system in which a graphical 
user interface (hereinafter a GUI) is used to display a hierarchical structure of a file system or the like in a screen and 
a pointing device such as a mouse is used to point out intended data, and thus data such as a file is accessed 

In the foregoing known browser system for visualizing a hierarchical structure for a user, a tree display shown in 
Fig. 1 8 or a hierarchical list box display shown in Figs. 1 9A and 1 9B is used to express a hierarchical structure. 

Fig- 18 -shows an example of expressing a hierarchical file system in the form of a tree structure Directory levels 
are depicted with icons of folders 101 . 103, 105, 108. 110, and 113. Files are depicted with icons of documents 102, 
104, 106, 107, 109. Ill, 112, and 114. The hierarchical interrelations are thus expressed in the form of a tree structure' 

In Fig. 18. reference numeral 101 denotes a root directory. The root directory 101 contains file R-1 102 The root 
directory 101 subordinates directory A 103, directory B 105, and directory C 108. The directory A 103 contains file A- 
1 104. The directory B 105 contains file B-1 106 and file B-2 107. The directory C 1-8 contains file C-1 109 and sub- 
ordinates directory D 110. The directory D 110 contains file D-1 111 and file 0-2112 and subordinates directory E 113 
The directory E 113 contains file E-1 114. 

As mentioned above, files of all levels are displayed in the form of a tree structure. An intended file can be selected 
easily. 

Figs. 19A and 1 9B show an example of a hierarchical list box expressing the same hierarchical file system as the 
one shown in Fig. 18. Fig. 19A shows a state in which an attempt is made to access a file and directory subordinate 
to directory C 116. In the drawing, reference numeral 115 denotes a list box for displaying files and directories of the 
first level. 117 denotes a.scroll bar used when the number of files or directories exceeds the number of items that can 
be displayed. 118 denotes a scroll up button. 119 denotes a scroll down button.. 11 6 denotes directory C. 

After directory C 116 is selected from the list box 115. when a button on a pointing device is clicked the display 
of the directory C 116 is reversed, and file C-1 and directory D 121 subordinate to the directory C 116 are displayed in 
a list box 120 for listing files and directories of the second level. 

Fig. 1 9B shows a state in which directory D 1 21 is selected from the list box 1 20 by clicking a button on the pointing 
device. In the drawing, when the directory D 121 is designated by clicking a button on the pointing device, directory E 
file D-1 , and file D-2 subordinate to the directory D 121 are displayed in a list box 122 for listing files and directories 
of the third level. Thus, an intended file is accessed by selecting lower levels step by step. 

A system for displaying a hierarchical file system using metaphors of folders; such as, the one installed in the OS 
for the Macintosh trademark of Apple Computer or the OS/2 trademark of IBM has become popular. 

When a hierarchical file system is expressed in the fomi of a tree structure in the same manner as the known 
hierarchical file system shown in Fig. 18. ii the number of files or directories is too large, all icons representing the files 
or directones cannot be displayed in a screen. A means for scrolling a whole screen is reouired in order to search for 
an intended directory or tile. This makes it rather hard to locate an intended directory or file. The display of a lower 
level becomes laterally long. The display of a level containing numerous files and directories becomes vertically long. 
The whole of a screen cannot often be used effectively for display. A screen must be scrolled more frequently 

As for the browser system using the known list box shown in Figs. 1 9A and 1 9B, hierarchk:al browsing is enabled 
despite a narrow screen. However, unless a directory is selected, files and directories subordinate to the directory do 
not appear. It is therefore difficult to grasp the whole hierarchical structure. An intended file cannot be located quickly. 

As for the known system using metaphors of folders for expressing a hierarchical structure, what kind of data is 
contained in a folder cannot be found until the folder is opened. The whole image of a hierarchical structure nested to 
two or more levels cannot be grasped. Every time a folder is opened, a new window is opened. A window showing an 
opened folder messes up a screen of a desktop computer Intended data is liable to be lost. 

The foregoing drawbacks also lie in a browser system using a data base in which data is categorized hierarchically 
and adopting either of the foregoing display methods. 

In a file management system or data base system for a computer, a date is used as an important parameter for 
managing numerous data items. In the file management system, for example, a date of creation of a file or a date of 
correction thereof is appended automatically as an attribute of the file. In the data base system, a date field is defined 
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in data. A date entered in the field is used to manage the data. 

A personnel management data base 30 shown in Fig. 5 will be taken for instance. A date of birth is entered in a 
date field 31 and used for personnel management, tn schedule table application software <hereinafter. a scheduler), 
schedules themselves are managed using dates. For example, when the contents of a schedule indicate a conference, 
5 document files scheduled to be used at the conference are registered in tfie tonm of a data base. It will be able to check 
what kinds of materials were used at the conference. This is convenient. 

For retrieving intended data from a data base that is a set of data items, the foregoing data is used as an important 
parameter. In the file management system, files are sorted by date of creation or date of correction and then displayed. 
This enables a user to memorize creation or correction of files and to search for intended data. In the data base system, 
^0 for example, in a personnel management data base system, retrieval and display in order of date of birth are normally 
adopted. In the scheduler, a desired relevant data file can be located by checking the contents of schedules by date. 

For users, the most typical unit of memory can be said to be a date. A date of creation or correction of a file is 
memorized vaguely in general. Even if a user forgets a file name, he/she can locate the file by collating his/her memory 
with a date of a file. The same applies to the scheduler. Desired contents can be retrieved on the basis of a vague 
75 memory of a date. In the data base system, when files are retrieved in order, for example, by date of birth, data can 
be checked orderly. 

However, in the known file management system. It cannot be found explicitly whether dates associated with files 
displayed vertically adjacently in a list are close to or separated from each other. A user must therefore carry out the 
work of: checking dates; estimating a time Interval between each pair of dates whichever the dates are close to or 

20 separated from each other; collating his/her rnemory with a date of a file, and then locating a desired file. Fig. 4 shows 
an example 20 of a known display of the file management system. As shown in Fig. 4, files contained In a designated 
directory 21 are displayed in descending order of date. However, a date display column 22 must be checked item by 
item in order to grasp what data is created at what date. 

As for a display of a data base system, when data items are displayed in order ot date of birth, even if there noay 

25 be a diflerence of one year or ten years in age between a certain person and the next person, the data items concerning 
the persons are displayed at one and next position orderly. A user therefore must check dates associated with data 
items numerically, and estimate a difference between each pair of dates. When there are many people of a certain 
generation but few people of a certain generation, if a user wants to understand an overall trend, time-consuming work 
is needed. In reality, dates of birth are sorted chronologically and displayed or plotted as a graph in an effort to grasp 

30 the overall trend. 

There is an increasing demand for a system enabling a user to grasp time intuitively and sensuously 
Recently, what is called catalogue software has made its debut as data base software running in a persona! com- 
puter. The catalogue software is a data base handling graphics, documents, and images mainly Fundamentally, a 
reduced image (hereinafter a thumbnail image) is created for each data, arxJ desired data is searched by checking 

55 (browsing) the reduced images. 

For supplementing retrieval based on browsing, what is called a free keyword is usually appended. The free key- 
word is a keyboard to which no field is allocated. A keyword to which a field is allocated is specified in a field defined 
in a relational data base or card type data base. As far as the catalogue software is concerned, retrieval using a free 
keyword is possible. Desired data is picked up using a result of retrieval in combination with browsing. 

40 A kind of catalogue software putting an emphasis on images may sometimes be called album software. In the 

album software, as its name assigned in consideration of an album for making a collection of photographs implies, 
images are mainly stored in a data base. A wanted image is picked up, fundamentally, on the basis of browsing and 
a supplemental free keyword. 

In case ot an album for making a collection ot photographs, a user not only Inserts photographs but also writes 

4£ down comments or overlays a sheet of paper shown in Fig. 62 (hereinafter, a frame), which reveals any specific part 
of a photograph and hides the other part thereof, on a photograph. This is a commonly adopted technique for attracting 
attention to a specific photograph or highlighting an impressive photograph. 

For implementing the technique shown in Fig. 62 in the album software, very complex operations are needed to 
cut out an image using a user-specific frame and store a resultant image. Fig. 63 is a flowchart describing the operating 

so procedure. At step S201 , application software for drawing graphics (hereinafter drawing software) is activated, and a 
frame is created. In Fig. 64, refererce numeral 901 denotes an example of a frame created. At step S202, an innage 
is read into the drawing software, and superposed on the frame by adjusting the size of the image. In Fig. 64, 902 
denotes an example of the image superposed on the frame. At step S203, application software for noanipulating or 
editing an image (hereinafter, photo retouch software) is activated. The image superposed on the frame is fetched into 

55 the photo retouch software via a clipboard. Within the drawing software, a frame and imajge can be handled mutually 
separately. Once fetched into the photo retouch software, the frame and image are made into one image. At step S204, 
a portion of the image outside the frame ts erased within the photo retouch. Reference numeral 904 in Fig. 64 denotes 
an example of erasure. At this time, an area designation tool and eraser tool of the photo ratouch software are used. 
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904 in Fig. 64 denotes an example of a resultant corrected image. At step S205, the corrected image is saved as a 
new innage in a file. At step 206, the image is fetched into the album software - . 

The known procedure of cutting out an image and fetching it into the album software involves activation of some 
software packages. The procedure is very complex and the work is hard. For carrying out the foregoing operations, a 
5 user is requested to have expertise. 

Another problem is that a frame and image are made info a single image. When the shape of the frame or a visible 
portion of an image is wanted to be changed from one portion to another, the procedure described in the flowchart of 
Fig. 63 must be performed from the beginning. Moreover, images that have not been corrected are usually stored as 
they are. Two kinds of images; raw images and images cut out in combination with frames are stored separately 

JO For these reasons, an easier method for creating a frame and producing a cutout image and a flexible method 

permitting future correction are needed. 

It is important that a frequently-used file can be easily located or retrieved Irom among numerous files. In the 
example shown in Fig. 18. when a frequently-used file resides at a deep position in a hierarchy or many files and 
directories are present at the same hierarchical level, the frequently-used file cannot be located easily. Even in the 

'5 example shown in Figs. 19A and 19B. it is rather hard to retrieve a frequently-used file. 

The same applies to a browser system using a data base in which data items are categorized hierarchically. 
An object of a first aspect o1 the present invention is to provide a hierarchical data display method and browser 
system in which the hierarchical structure of a file system or data base having a hierarchical structure is displayed in 
the form ol a Venn diagram so that the whole structure can be grasped intuitively, data belonging to child hierarchical 

^0 levels IS not hidden but displayed in the form of reduced images so that intended data can be located easily 

Thoie ts provided a hierarchical data display method and browser system in which a deep hierarchical structure 
c^n be displayed within a screen of a limited area, a zoom-in means makes it possible to visualize detailed information 
concc/ning an intended hierarchical level quickly, and a zoom-out means makes it possible to obtain a brief idea on a 
hierarchical structure viewed from an higher level. 

-5 There is provided a hierarchical data display method and browser system in which since it is indicated a level of 

whch hiorarchical depth is cunently zoomed in, a current hierarchical depth can be grasped intuitively during navigation. 

According to one aspect, a hierarchical data display method of the present invention for displaying data items 
m^inagod hierarchically is characterized in that a display area is divided into an area in which data icons representing 
d.Hra Items belonging to one level and an area in which child levels are displayed, and the data icons are displayed 

^ with a S!/e varied depending on a hierarchical depth. 

The data icons are made smaller in size as the hierarchical depth increases, and the data icons are made simpler 
as the hierarchical depth increases. The sizes of the division areas are determined on the basis of the number of data 
ilcms belonging to one level and the numbers of data itenns belonging to child i^els. When there are a plurality of child 
levels, a display area for each child level is determined according to the number of data items belonging to levels 

2S subordinate to the child level. The chiW levels are displayed in a background representing the parent level. The back- 
ground is selected and displayed so that a hierarchical depth can be recognized. As the hierarchical depth increases, 
the background is displayed in deeper color. A procedure for zooming in a desired level is realized by designating the 
display area for the desired level and then carrying out a given operation. A procedure for displaying the detailed 
contents of a desired level is realized by performing a given operation after designating the display area for the desired 

-to level. A procedure is provided for zooming out a level, which has zoomed up by pertorming the given operation, so as 
to transfer a view point to a parent level. A procedure is provided for grouping a plurality of desired data icons and 
displaying a leading data icon in such a way that the group of data icons can be recognized. A procedure is provided- 
for displaying a list of a plurality of data icons grouped. In addition, procedures are provided for rearranging a plurality 
of data icons grouped, releasing a group, and deleting a desired data icon from among a plurality of data icons grouped, 

4£ A hierarchical data browser system of one embodiment of the present invention for displaying data items managed 

hierarchically comprises a display area dividing means for dividing a display area into an area, in which data icons 
representing data items belonging to one level are displayed, and an area in which child levels are displayed, and a 
data icon display means for displaying the data icons with a size varied depending on a hierarchical depth. 

The data icon display means makes the data icons smaller in size as tha hierarchical depth increases. The data 

so icon display means makes the data icons simpler as the hierarchical depth increases. The display area dividing means 
determines the sizes of the division areas according to the number of data items belonging to one level and the number 
of data items belonging to child levels. When there are a plurality of child levels, the display area dividing means 
determines a display area for each child level according to the number of data items existent at levels subordinate to 
the child level. The data icon display means includes a background display means for displaying the contents of one 

ss level in the same background. The child levels are displayed in a background representing the parent level. The back- 
ground is selected so that the hierarchical depth can be recognized. The background is displayed in deeper color as 
the hierarchical depth increases, fy/loreover. a zoom-in means is provided for zoorning in a desired level by performing 
a given operation after designating the display area for a desired level. A detailed contents display means is provided 
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for displaying the detailed contents of a desired level by performing a given operation after designating the display 
area for a desired level. A zoom-out. means is provided for zooming out a level, which has been zoomed in by performing 
the given operation^ so as to display a parent level, A grouping means is provided for grouping a plurality of ciesired 
data icons and displaying a leading data icon so that the it can be recognized that a plurality of data icons are grouped 

s together. A list display means is provided lor displaying a list of a plurality of data icons grouped together. Means are 
provided for changing a representative picture of a plurality of data icons grouped together from one picture to another, 
for releasing a group, and for deleting a desired data icon from a pturatity of data icons grouped together. 

The hierarchical data browser system of one embodiment of the present invention includes a hierarchical data 
managing means that manages a plurality of data items hierarchically, and a level display means for defining an area, 

TO in which ail data items belonging to one level and child levels are displayed, with a border encircling the whole area 
according to the infonmation representing levels which is retained by the hierarchical data managing means, displays 
the area as an area having a background painted in given color, expresses the data items to be displayed In the display 
area in the form of data icons serving as data identification information, and depicts display areas for levels to be 
displayed in the display area; that is, the child levels within the level display area using the same conr^ponent elements. 

75 The level display means includes an area defining means that calculates a minimum necessary area in advance 

so as to display data icons within one level display area, and defines a display area for child levels and a display area 
for data icons proportionally according to a ratio of the number of all data items belonging to the child levels and levels 
subordinate to the child levels to the number of data items belonging to a marked level to such an extent that the display 
5 area for data icons will not be smaller than the minimum necessary area. The level display means makes the data 

20 icons smaller in size and simpler as the hierarchical depth incieases. The level display means further includes a zoom- 
in means for zooming in a level so as to move a view point to a deeper position in a hierarchy, a zoom-out means for 
zooming out a level so as to move a view point to a shallower position in the hierarchy, and a hierarchical depth indicating 
means for indicating the hierarchical depth of a zoomed-in level and a zoom directran. As for the zoom direction, when 
the zoom-in means Is selected, a direction toward a deeper position in a hierarchy is indicated. When the zoom-out 

2S means is selected, a direction toward a shallower position in the hierarchy is indicated. The level display means includes 
an assessing means for assessing the size of an area alkxated to one data icon relative to a threshold of the size of 
a hierarchical area used as a reference in assessing the size of an area allocated to one data icon, and a setting means 
for setting at least one of presence or absence of an icon picture expressing a data icon, presence or absence of a 
data name, a font size used to display a data name, and a size of an icon picture on the basis of the result of assessment. 

30 When an available memory is small, the assessing means accordingly increases the threshold of the size of an area 
allocated to one data icon used to determine whether icon picture display should be executed. A grouping means is 
provided for grouping a plurality of data icons for management and displaying the plurality of data icons as a group 
icon. Further included are a list display means for use in displaying a list of data icons belonging to a designated group 
by designating a group icon, and a detailed information display means for use in displaying detailed information of 

j£ designated data by designating a desired data icon selected from the list. Means are provided for changing a repre- 
sentative picture of a plurality of data icons grouped together from one picture to another, for releasing a group, and 
tor deleting a desired icon from a plurality of data icons grouped together 

An object of a second aspect of the present invention is to provide a time-series data display method for displaying 
time-series data items so that a user can grasp time more intuitively and sensuously, and an information processing 

-^0 system for realizing the time-series data display method. 

A time-series data display method of one aspect of the present invention for displaying accumulated lime-series 
d£ta items time-sequentially is characterized in that first data associated with a desired date is retrieved and displayed, 
and second data associated with a date contiguous to the desired date is retrieved and displayed in a temporal direction 
starting on the desired date so that the second data can be distinguished from the first data. 

-^5 For the distinguishable display, the display area for the second data is made smaller than the display area for the 

first data. The first data is displayed at an outermost position in a display screen, and the second data is displayed 
inside the first data with the display area therefor made smaller. A third data associated with a date contiguous to the 
date oi the second data is retrieved, and displayed inside the second data with the display area therefor made smaller. 
The display of each date is limited to a given number of data items. When the number of data items exceeds the given 

so number, the data items are classified in units of a finer date and displayed mutually distinguishabty. When zoom-in is 
designated for a screen display, the display positions for the first to third data items are shifted outward. The display 
areas for the first to third data items are made larger accordingly. The zoom- in mode continues for a designated period 
of time. The first data is moved out of the display screen. New data associated with a date contiguous to the date of 
the data displayed at an innermost position is retrieved and displayed at the innermost position. When zoom-out is 

ss designated for a screen display, the diisplay positions for the first to third data are shifted inward. The display areas for 
the first to third data are made smaller accordingly. The zoom-out mode continues for a designated period of time. The 
data displayed at an innermost position is moved out of the display screen. New data associated with a date contiguous 
to the date of the data displayed at an outermost position is retrieved and displayed at the outermost position. Zoom- 
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in or zoom-out is designated in a screen, -and the speed of shifting display positions is varied depending on a designated 
position in the screen. With the displays of data items, graphics such as rings or squares indicating dates of the displays 
are nested and displayed. For the nested display, the graphics such as rings or squares representing dates associated 
with displays are displayed concentrically in units of a given date. Data items are sorted accordingly and displayed on 

5 the graphics. The graphics such as rings or squares representing dates associated with displays are displayed in 
different colors associated with dates. The data items are positioned in the graphics at random. The random positions 
are specified at the time of data registratbn. The accumulated time-series data includes data items accumulated in 
one-to-one correspondence to dates of creation of data files, data items accumulated in one-to-one correspondence 
to dates of correction of files, and data items accumulated in one-to-one correspondence to designated dates registered 

10 by a user. 

A time-series data display method of the present invention for dispiaying accumulated time-series data items time- 
sequentially is characterized in that data items are accumulated in one-to-one correspondence to dates of a schedule 
table, the schedule table is displayed, and data associated with a desired dste is displayed by designating the desired 
date of the schedule table. 

An information processing system of one aspect of the present invention for displaying accumulated time-series 
data items time-sequentially comprises an accumulating means for accumulating data items in one-to-one correspond- 
ence to dates, a retrieving means for retrieving data associated with a desired date and data associated with a date 
contiguous to the desired date responsively to designation of a desired date, and a display means for displaying re- 
trieved data distinguishabty in a temporal direction starting on the desired date. 
20 The display means displays the data associated with a dale contiguous to the desired date with the display area 

therefor made smaller than the one for the data of the desired date according to an elapsed time/The display means 
displays the data of the desired date at an outermost position in a display screen, and displays the data of the date 
contiguous to the desired date inside the data of the desired date with the display area therefor made smaller in pro- 
portion to an elapsed time. The display means includes a display limiting means for limiting the display of each date 
to a given number of data items, and a display dividing means that when the number of data items exceeds the given 
number, classifies the data itenns in units of a finer date and displays the data items mutually distinguishably The 
accumulating means includes a subdividing and accumulating means for subdividing a data accumulation unit in units 
of a finer date until the number of data items does not exceed the given number. Further includedare a zoom designation 
means for use in designating zoom-in or zoom-out for a screen display, and a zoom control means that when zoom- 
30 In is designated, shifts the display positions for data hems outward so as to increase the display areas therefor, and 
that.when zoom-out is designated, shifts the display positions of data items inward so as to decrease the display areas 
therefor The zoom control means includes a display data updating means that when zoom-in is designated, moves 
the data of a desired date out of the display screen, retrieves new data associated with a date contiguous to the date 
of the data displayed at an innernrHDSt position, and displays the new data at the innermost position, and that when 
3S zoom-out is designated, moves the data displayed at the innermost position out of the display screen, retrieves new 
data associated with a date contiguous to the date of the data displayed at an outennost position, and displays the 
new data at the outermost position. The zoom designation means includes a designation input means for use in making 
designation in a screen. The zoom control means varies the speed of shifting the positions of data items according to 
a designated position in a screen. The display means includes a means for concentrically displaying graphics such as 
rings or squares representing dates associated with displays in units of a given date, and a means for displaying data 
items orderly in the graphics. The graphics such as rings or squares indicating dates associated with displays are 
nested and displayed together with the displays of data items. The display means displays the graphics such as rings 
or squares representing dates associated with displays in different colors associated with the dates. The display means 
positions data items in the graphics at random-. The accumulating means specifies the random positions at the time 
^ of data registration. The accumulated time-series data items include data items accumulated in one-to-one correspond- 
ence to dates of creation of data files, data items accumulated in one-to-one correspondence to dates of correction of 
files, and data Items accumulated in one-to-one correspondence to designated dales entered in by a user. 

An information processing system of one aspect of the present invention for displaying accumulated lime-series 
data time-sequentially comprises an accumulating means for accumulating data items in one-to-one correspondence 
50 to dates of a schedule table, a first display means for displaying the schedule table, and a second display means for 
displaying data associated with a desired date of the schedule table responsively to designation of the desired data. 

An object of a third aspect of the present invention is to provide an image editing method and system in which an 
image can be cut out by performing a simple operation and fetched into album software, or the size of a cutout can be 
varied. 

55 There is provided an inr^g^ editing method and system in which a whole hierarchical structure can be grasped 

easily and an intended file can be located effortlessly, and an image editing method and system in which a frequently- 
used file can be picked up from among numerous files effortlessly. 

An image editing method of one aspect of the present invention for cutting out a designated area of an image in 
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given form is characterized in that a plurality of cutout forms are registered, one of the registered cutout forms is 
designated and placed at a desired position in an image, the cutout form is enlarged or reduced to a desired size, and 
then the portion of the image inside the cutout form is output as a cutout inaage. 

An image editing method of one aspect of the present invention for cutting out a designated area of an image in 
5 given form is characterized in that a cutout form and image are registered mutually Independently, an identifier, position, 
and size of the cutout form are registered as attributes of the image, and the registered cutout fomn is placed at a 
desired position in the image. When the cutout form is enlarged or reduced to a desired size, the Identifier, position, 
and size of the cutout form are registered as attributes of the image. Based on the registered attributes of the image, 
the portion of the image inside the cutout form is output as a cutout innage, 
TO The cutout form is placed on the center of a portion of an image to be cut out, and then enlarged or reduced with 

the center fixed. The cutout form is composed of a form used to cut out an image and a form to be output as a perimeter 
of the cutout. The cutout image is used as a Sumner image in a data base system. 

An image editing method of one aspect of the present invention to be implemented in a hierarchical data manage- 
ment system for managing a plurality of data items hierarchically is characterized in that an icon display size repre- 
ss senting a size of a icon to be displayed and a data icon display position representing a display position tor an icon are 
registered as attributes of each data. An icon display size and data icon display position are determined in hierarchical 
order, whereby data icons sen/ing as data identification intormaiion can be displayed with a size made different in 
hierarchical order so that data icons belonging to the same level can be distinguished from those belonging to other 
levels. 

20 By varying an icon display size and data icon display position, a level or data icon is zoomed in. panned, or zoomed 

out. An access frequency meaning the number of accesses gained to data is included in the attributes of the data. A 
data icon representing data whose access frequency is relatively high is displayed with a relatively large size. 

An image editing method of one aspect of the present invention to be implemented in a hierarchical data manage- 
ment system for managing a plurality, of data itenrts hierarchically is characterized in that data icons serving as data 

2£ identification information are displayed with a size made different in hierarchical order, a desired data icon is designated 
in order to access the data, and a data icon representing data whose access frequency is relatively high is displayed 
with a relatively large size. 

Data icons belonging to the same level are displayed distinguishably from those belonging to other levels. A level 
to which data having a relatively high access frequency belongs is displayed with a re lative^y large size. When a data 

30 icon displayed with a relatively large size is not accessed for a period of time exceeding a certain period, the data icon 
is reduced in proportion to the period during which it is not accessed or a frequency by v/hich any other data is accessed. 
A desired level or data icon is designated, and then zoomed in,. panned, or zoomed out. Data icons belonging to a 
level subordinating a marked level are. vignetted and displayed. Vignetting is achieved by enlarging raw data repre- 
senting the number of pixels smaller than the number of pixels to be displayed. Data icons belonging to a higher level 

55 are vignetted more intensely. The data -attributes include one of date information representing a dale of creation of 
data, date information representing a data of access gained to data, and date information specified in data. An icon 
display size and data icon display position are determined date-orderly, whereby data icons serving as data identifica- 
tion information are displayed with a size made different date-orderly so that data icons associated with the same dale 
can be displayed distinguishably from those associated with other dates. By varying an icon display size and data icon 

^0 display position, data icons associated with the same date are zoomed in or out. Moreover, either hierarchical display 
or date-orderly display can be selected. A position in a entire hierarchy being currently displayed in a screen is displayed 
within a separate window in the form of a position on a plane defined with vertical and lateral lines and a position in a 
depth direction. When a desired position is designated in the separate window, a desired level can be displayed at a 
desired enlargement ratio. 

45 An image editing system of one aspect of the present invention tor cutting oui a designated area of an image in 

given form comprises a registering means tor registering a plurality of cutout forms, a situating means for use in des- 
ignating one of the registered cutout forms and situating it at a desired position in an image, a changing means for use 
in changing the size of a cutout form into a desired size, and a cutout means for outputling a potion of an image inside 
a cutout form as a cutout image. 

so An image editing system of one aspect of the present invention for cutting out a designated area of an image in 

given form comprises a registering means for registering a cutout form and image mutually independently, a situating 
means for use in situating a registered cutout form at a desired position in an image by performing a given operation, 
a changing means for use in enlarging or reducing the cutout form into a desired size by performing a given operation, 
an attribute registering means for registering an identifier, position, and size of the cutout form as attributes of the 

55 image, and an image output moans for outputting the portion of the image inside the cutout form as a cutout image 
according to the registered attributes of the image. 

The situating means aligns the center of a cutout form with the center of a portion of an image to be cut out. The 
changing means enlarges or reduces a cutout form with the center thereof fixed. The registering means registers each 
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cutout form as a lorm used to cut out an image and a fomn to be output as a perimeter of a cutout. The image editing 
systenn is implemented in a data base system. A cutout Image is used as a Sumner image 

An image editing system of one aspect of the present invention to be implemented in a hierarchical data manage- 
ment system for nnanaging a plurality of data items hierarchically 5 comprises an attribute registering means for reg- 
istering an icon display size representing a size of an icon to be displayed and a data icon display position representing 
a display position for an icon as attributes of each data, and a first display means for determining an icon display size 
and data icon display position in hierarchical order, and thus displaying data icons sen/ing as data identification infor- 
mation with a size made different in hierarchical order so that data icons belonging to the sanne level can be distinguished 
from those belonging to other levels. 

A first display changing means is provided for zooming in. panning, or zooming out a level or data icon by varying 
an icon display size and data icon display position. A second display changing means is provided for registering an 
access frequency meaning the number of accesses gained to data as an attribute of the data and for displaying a data 
icon representing data whose access frequency is relatively high with a relatively large size. 

An image editing system of one aspect of the present invention to be implemented in a hierarchical data manage- 
ment system for managing a plurality of data items hierarchically comprises a display means for displaying data icons 
serving as data identification information with a size made drfterent in hierarchical order, an access means for use in 
accessing data corresponding to a desired data icon by designating the data icon, and a second display changing 
means for displaying a data icon representing data whose access frequency is relatively high with a relatively targe size. 

The display means displays data icons belonging to the same level distinguishably from those belonging to other 
levels. The second display changing means displays a level to which data whose access frequency is relatively high 
belongs with a relatively large size. When a data icon displayed with a relatively large size has not been accessed for 
a period exceeding a certain period of time, the second display changing means reduces the data icon in proportion 
to the period during which the data icon is not accessed or a frequency by which any other data is accessed. A first 
display changing means is used to designate a desired level or data icon and to zoom in, pan. or zoom out the level 
or data icon. The first display changing means includes a vignetting means for vignetting data icons belonging to a 
level subordinating a nnarked level and then displaying the data icons. The vignetting means achieves vignetting by 
enlarging raw data representing the number of pixels smaller than the number of pixels to be displayed. The vignetting 
means vignettes data icons belonging to a higher level more intensely. The attribute registering means includes a 
second display means for registering one of date information representing a date of creation of data, date information 
representing a date of access gained to data, and date information specified in data as an attribute of each data, for 
determining an icon display size and data icon display position date-orderly, and thus displaying data icons sen/ing as 
data identification infomnation wrth a size made different date-orderly so that data icons associated with the same date 
can be distinguished from those associated with other dates. A third display changing means is provided for zooming 
in or out data icons associated with the same date by varying an icon display size and data icon display position. A 
switching means is provided for selecting either the first display means or second display means. The first and second 
display means display a position in an entire hierarchy, which is currently displayed in a screen, in a separate window 
in the form of a position on a plane defined with vertical and lateral lines and a position in a depth direction. A display 
designating means is used to designate a desired position in the separate window so as to display a desired level at 
a desired enlargement ratio. 

Embodiments of the present invention will now be described with reference to the accompanying drawings in which: 

Fig. 1 shows an example of the configuration of a persona! computer system of an embodiment; 

Fig. 2 shows an example of the configuration of a hierarchical data management system including software and 

hardware; 

Fig. 3 shows an example of a display in an embodiment; 
Fig. 4 shows a file management system of a prior art; 
Fig. 5 shows a data base system of a prior art; 

Fig. 6 is an explanatory diagram concerning zoom-in display and zoom-out display; 
Fig. 7 shows cells used to manage time; 

Fig. 8 shows an example of a display of rings corresponding to hierarchical cells; 

Fig. 9 shows a data structure of a cell list; 

Fig. 10 shows a data structure of a display step list; 

Fig. 11 is a flowchart describing a sequence for acquiring a cell corresponding to an outermost ring; 

Fig. 12 is a flowchart describing a sequence of initial display; 

Fig. 1 3 is a flowchart describing a sequence of display during zoom-in; 

Fig. 1 4 is a flowchart describing a sequence of display during zoom-out; 

Fig. 15 is a flowchart describing a sequence of data addition; 

Fig. 16 shows an example of a display of a scheduler; 
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Fig. 17 shows an example of a display of hierarchical data in an embodiment; 
Fig. 18 shows a tree structure of a hierarchical file system; 
' Figs. 1 9A and 1 9B show examples of expressing the same hierarchical file system as the one shown in Fig. 18 in 

I the form.of a hierarchicallist box; 

s Fig. 20 shows an example of a zoomed-tn display of directory C; 

Fig. 21 shows an example of a zoomed-in display of directory E; 
Fig. 22 shows the detailed contents of a file; 

Fig. 23 is an explanatory diagram concerning zoom-out of a zoomed-in display of directory E; 
Fig. 24 shows a method for designating detailed informatbn display of data indirectly; 
10 Fig. 25 is a flowchart describing a sequence according to which a level display means sets the sizes of level display 

area for a level and of data icons; 

Fig. 26 shows an example of a result of dividing a screen for a root directory into a data icon display area.and child 
level display area; 

Fig, 27 shows a state in which the display areas for child levels subordinate to a root level of hierarchical depth 0, 
15 and the display size and position of a data icon are determined; ^ 

Fig. 28 is a flowchart describing a sequence for zooming in a given level; 

Fig. 29 Is a flowchart describing a sequence for zooming out a grven zoomed-in level so as to display the given 
level together with higher levels; 

Fig. 30 Is a flowchart describing a sequence for determining the display area for data icons; 
20 Fig. 31 shows an example of a display of an employee data base in an embodiment; 

Fig. 32 shows an example of a display of detailed information; 

Fig. 33 shows an example of a display In a state in which a root level is displayed as a level display; 
Fig. 34 shows a state in which the level display area for directory C is zoomed in; 
Fig. 35 shows a state in which the level display area for directory E is zoomed in; 
25 Fig. 36 shows a state in which the level display area for directory B is zoomed In; 

Fig. 37 is an explanatory diagram concerning a hierarchical depth indicator for indicating a hierarchtcal depth ot a 

level for which a level display area is zoomed in by a user; 

Fig. 38 shows another example ot a hierarchical depth Indicator; 

Fig. 39 shows the configuration ot a personal computer system serving as a platform of an embodiment; 
30 Fig. 40 shows the configuration of a hierarchical data browser system including software and hardware in an 

embodiment; 

Fig. 41 is an explanatory diagram concerning hierarchical attribute data managed by a level noanager in an em- 
bodiment; 

Fig. 42 shows a data structure of data attributes; 
55 Fig. 43 is an explanatory diagram concerning component elements of a display used by a level display unit tor 

displaying data items belonging to a level according to data managed by the level manager shown in Fig. 40; 

Fig. 44 shows a data structure of data attributes in the third embodiment; 

Fig. 45 is an explanatory diagram concerning component elements of a display of a data icon; 

Fig. 46 shows the detailed configuration of a hierarchical data browser system; 
40 Fig. 47 is a flowchart describing a sequence for determining a data icon display format according to a size ot a 

display area allocated to one data icon at step 125 in the flowchart of Fig. 30; 

Fig. 48 shows an example of a data name display font size table; 

Fig. 49 shows an example of a minimum data icon picture display size table; 

Fig. 50 shows examples of data icon display formats determined as described in the flowchart of Fig. 47; 
45 Fig. 51 shows an example ot applying the sequence of Fig. 47 to display ot data icons in which innage data is 

categorized hierarchically and displayed In the form of a Venn diagram; 

Fig. 52 shows an example of a data display in a level display area in a data base created by an insurance company 
for the purpose of acquisition of customer information; 

Figs. 53A to 53C are explanatory diagrams concerning a method of grouping a plurality of data icons in a hlerar- 
so chical data browser In an embodiment; 

Fig. 54 shows an example of a display in which four high-level data icons shown in Fig, 52 are integrated into one 
group and four low- level data icons are integrated into one group; 

Figs. 55A to 55D show methods for accessing each of data icons grouped in an embodiment; 
Figs. 56A and 55B are explanatory diagrams concerning operations for removing data from a group; 
55 Fig. 57 is an explanatory diagram concerning a data structure o1 group attribute data used by a level managing 

means for managing grouped data icons; 

Fig. 58 is an explanatory diagram concerning the components of a group icon; 

Fig. 59 shows examples ot data icon display formats determined according to the sequence described in the 
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flowchart of Fig. 47 and used when an available memory is limited; 

Fig. 60 shows an example o1 applying the sequence of Fig. 47 to display o1 data icons in which when an available 

memory is limited, image data is categorized hierarchically and displayed in the form of a Venn diagram; 

Fig. 61 shows an example of a display screen of album software in the fourth embodiment: 

Fig. 62 shows an example ol a photograph preserved in an album; 

Fig. 63 is a flowchart describing a procedure for cutting out an innage using known software; 

Fig. 64 shows a known example of producing a cutout of an image; 

Fig. 65 shows an example of a palette in which frames are registered in the fourth embodiment; 

Fig. 66 is a flowchart describing a procedure for cutting out an inoage in the fourth embodiment; 

Fig. 67 is an explanatory diagram concerning comparison of a structure of a cutout image in a prior art with that 

in the fourth embodiment; 

Fig; 68 shows a data management structure in the fourth embodiment; 

Fig. 69 is a flowchart describing a sequence for setting a transparent area in the fourth embodiment; 

Fig. 70 shows an example of a dialogue box for setting a transparent area in the fourth embodiment; 

Fig. 71 is a flowchart describing a sequence of palette registration in the fourth embodiment; 

Figs. 72A and 72B show examples of operations for cutting out an image in the fourth embodiment; 

Fig. 73 is a flowchart describing a sequence for registering frame data for an image in the fourth embodiment; 

Fig .74 is a flowchart describing a sequence for displaying a cutout stale of an image in the fourth embodiment; 

Fig. 75 is a block diagram showing the internal configuration of a personal computer in the fourth embodiment; 

Figs. 76A to 76C show an example ol continual 2oom-in display of directory C in the fifth embodiment; 

Figs. 77A to 77C show an example of continual zoom-in display centered on directory E in the fifth embodiment; 

Fig. 78 shows a zoomed-in display of directory E in the fifth embodiment; 

Fig. 79 shows a method for directly designating detailed inlormation display of data in the fifth embodiment; 

Fig. 80 is a flowchart describing a sequence of zoom-in or panning display in the fifth embodiment; 

Fig. 81 is a flowchart describing a sequence tor indicating a position in a z-axis direction in the fifth embodiment; 

Fig. 82 shows an example of a calculation for determining a position in a 2-axis direction in the fifth embodiment; 

Fig. 83A shows an example of an indication in a z-axis direction in the fifth embodiment; 

Fig. 83B shows an example of an indication in a z-axis direction in the fifth embodiment; 

Fig. 84 shows an example of a display of a navigation window in the fifth embodiment; 

Figs. 85A and 858 shews an example of panning display in the fifth embodiment; 

Fig. 86 shows data attribute data in the fifth embodiment; 

Figs. 87A and 87B are explanatory diagrams concerning a technique for increasing the size of a display relatively 
according to a use frequency of a file; . 

Fig. 88 is a flowchart describing a sequence for processing an accessed file in the fifth embodiment; 

Fig. 89 is a flowchart describing a sequence for processing a file that has not been accessed for a given period of 

time in the fifth embodiment; 

Fig. 90 is a flowchart describing a sequence for dividing a screen into a data icon display area and a child level 
display area in the fifth embodiment; 

Fig. 91 is a flowchart describing a sequence for setting the sizes of a level display area and data icons in the fifth 
embodiment; 

Fig. 92 shows an example of a display in a data base system handling images mainly in the fifth embodiment; 

Fig. 93 is a flowchart describing a sequence of innage enlargement in the fifth embodiment; 

Fig. 94 shows an example of a fitter array in the fifth embodiment; 

Fig. 95 shows an example of a filter array in the fifth embodiment; 

Fig. 96 shows an example of time-sequential display in the fifth embodiment; 

Fig. 97 shows an example of time-sequential display in the fifth embodiment; 

Fig. 98 is a flowchart describing a sequence for sening a time rectangle and a data icon in the fifth embodiment; 
Figs. 99A and 998 show an example of setting of a lime rectangular area and file icon display area in the fifth 
embodiment; 

Fig. 100 is a flowchart describing a sequence for setting a data icon in time-sequential display mode in the fifth 
embodiment; 

Fig. 101 is a flowchart describing zoom-in in time-sequential display mode in the fifth embodiment: 
Fig. 102 is an explanatory diagram concerning time rectangle attribute data in the fifth embodiment; and 
Fig. 103 is an example of data structure in an external storage medium such as a ftoppy disk. 
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[First Embodiment] 

<Example -of system configuration> 

s Fig. 1 shows an example of the configuration of a personal computer system serving as a platform in which the 

present Invention is implemented. 

In Fig. 1 , reference numeral 301 denotes a main unit of a computer system. 302 denotes a display for displaying 
data, 303 denotes a mouse typical of a pointing device. 304 denotes a mouse button. 305 denotes a keyboard. 
Fig. 2 shows the configuration of a hierarchical data management system including software and hardware. 

to In Fig. 2, reference numeral 509 denotes hardware. 505 denotes an operating system (OS) operating on the hard- 

ware 509. 504 denotes application software running under the OS 505. Some of blocks constituting the hardware 509 
or OS 505 which are components of the hardware 509 or OS 505 but not directly needed for describing the present 
embodiment are not illustrated. The unshown blocks constituting the hardware include a CPU and menoory, and those 
constituting the OS include a memory management system. 

1^ In Fig. 2, reference numeral 515 denotes a hard disk for physically storing files and data itenr^. 508 denotes a file 

system constituting the OS. The file system 508 has the ability to enable applicatk^n software to input or output files 
without awareness of hardware. 51 4 denotes a disk I/O interface for enabling the file system 508 to read or write<Jata 
from or in the hard disk 515. 

Reference numeral 507 denotes a drawing management system constituting the OS, The drawing management 
20 system 507 has the ability to enable application software to make a drawing without awareness of hardware. 51 3 
denotes a video interface for enabling the drawing nnanagement system 507 to make a drawing on the display 302. 

Reference numeral 506 denotes an input device management system constituting the OS. The input device man- 
agement system has the ability to enable application software to receive a user input without awareness of hardware. 
510 denotes a keyboard interface enabling the input device management system 506 to receive an input entered at 
^5 the keyboard 305. 512 denotes a mouse interface enabling the input device management system 506 to receive an 
input from the mouse 303. 

Reference numeral 501 denotes a dateorderly data browser. 502 denotes a date nnanaging module for managing 
data items date-orderly. 503 denotes a data display module for displaying the data items managed daleorderly in such 
a manner that the data items can be displayed time-orderly at intervals of a time between each pair of dates 
30 In Figs, 2, 40 and 75 showing the configuration of systems, reference numeral 515 may be a floppy disk or the 

same for storing files, data and/or program-modules, which include application softwares only or may also include 
operating systems. Some files, data and/or program-modules stored in a floppy disk 51 5 are loaded down into a memory 
(RAM) of a personal computer system before a CPU performs processes of the present invention by using the program- 
modules in the RAh/l. The floppy disk may be replaced with a host computer or a communication network. 

35 

<Example of a display> 

Fig. 3 shows an example of a display provided by a display method of this embodiment. 

Reference numeral 1 denotes a display screen. Squares 2a and 2b and other squares represent data items (or 

^0 may be referred to as data icons). 3a and 3b denote rings representing dates associated with the data items. On each 
ring, data items associated with the data expressed by the ring are arranged orderly The rings are nested toward the 
center of the screen and timed day by day toward the past or future. Data items on a ring closest to the perimeter of 
the screen are displayed with the largest size. This results in a display providing depth perception In which the perimeter 
of the screen is seen closest and the center thereof is seen farthest. When a user wants to display data icons, which 

45 are seen tar, with a larger size in the screen, he/she should execute zoom-in. By executing zoom-in, the data Icons 
are displayed more largely For example, the data icon 2b gets larger together with the ring 3b, and the ring 3a and 
data icon 2a are driven out of the screen and disappear. In contrast, when zoom-out is executed, the rings and data 
icons get smaller and gather around the center of the screen. Past or future data icons and rings come from outside 
of the screen. 

50 \na lite management system, after a certain directory Is selected, when date-orderty display of this embodiment 

is designated, display is pertomried so that a ring of a date of that day can be seen closest. By default, a direction seen 
receding represents a direction toward the past, and a direction approaching represents a direction toward the present. 
A user can reverse this direction. When a desired data item is located, the data icon displayed is designated by double- 
clicking a mouse button. The data file is then opened in a separate window The contents of the data file can be checked 

55 or edited. 
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<Zoom-in or zoom-out> 

Fig. 6 shows examples o1 a ring and exannples of zoomed-tn and -out displays, \A.tierein a data icon on the ring is 
nnarked. 

5 In Fig. 6, a point seen tar represents a past point and a point seen ctose represents a future point. Reference 

nunrierals 40a, 40b, 40c, and 40d denote display screens. 42a. 42b, 42c, and 42d denote a ring representing a date 
in different states. 41 a, 41b. 41 c. and 41 d denote a data icon on the ring (a data Item in the time band represented by 
the ring) in the different states. 

As shown In Fig. 6, when zoom-in is executed (past data items are viewed consecutively), first, the data icon 41a 

10 and ring 42a appear on the center of a screen with a small size (upper left). When zoom-in is continued, the data icon 
4la and ring 42a become the data icon 41b and ring 42b (upper right), the data icon 41c and ring 42c (lower right), 
and then the data icon 4ld and ring 42d (lower left). Thus, the data icon 41a and ring 42a are displayed with sizes 
increased orderly. The data icon 4ld is displayed so largely that part thereof is visible. When zoom-in continues further, 
the data icon will disappear from the screen. When zoom-out is executed, the foregoing display direction is reversed. 

15 In the state of the display screen 40a, in reality, the ring 42a is encircled by a larger ring representing a one-step 

future time band relative to the ring 42a The ring is encircled by a larger ring representing a one-step future time band. 
In the display screen 40d, in reality the ring 42d is encircling a smaller ring representing a one-step past time band 
relative to the ring 42d. The small ring is encircling a much smaller ring representing a one-step past time band. The 
displays shown in Fig. 6 are realized as a whole. 

20 . When data icons are sorted by date and displayed, if zoom-in or -out is executed in order to display the data icons 
consecutively, data display harmonious with a user's memory can be realized. Moreover, how data items are arranged 
in a time-axis direction can be grasped intuitively. 

<Dato struct ure> 

2S 

Fig. 7 is a conceptual diagram showing a data structure in this embodiment. 

Reference numeral 50 denotes a time band. segmented in units. of a certain time inten/al and associated with one 
ring displayed. In this embodiment, the time band 50 represents one day and is referred to as a cell. Data items 51 
associated with a time band of a cell are hung on the cell. For display, a ring is drawn for each cell, and data icons 
30 representing data items belonging to the cell are drawn on the ring. When zoom-in or -out is executed, the array of 
cells is advanced right ward or leftward and then data icons are displayed. 

When numerous data items belongs to a certain cell, or other words, numerous data itenr^ are associated with a 
time band of a certain cell, the data items should be displayed slowly so that all the data items can be checked carefully. 
A cell containing the number of data items larger than a given number is divided into cells of a shorter time band. In 
3S the example of Fig. 7, many data items betong to cell 10/7. The cell is therefore divided into four cells at intervals of 
six hours. Numerous data items belong to cell 12:00-18:00. The celt is therefore subdivided at intervals of one hour. 
Thereafter, a cell is subdivided at intervals of ten minutes, one minute, ten seconds, one second, etc. until the number 
of data items belonging to one cell becomes smaller than or equal to the given number. 

For display, as indicated with arrows, hierarchical cells are displayed orderly. Display is performed ceil by cell. The 
40 display speed decreases in a time band around which many data items gather. 

<Display of dates> 

For explicitly informing a user of the tact that the display speed decreases, the rings shown in Fig. 6 are displayed 
45 with a color made lighter in a direction of an auxiliary arrow 60 depicted with a dashed line: that is. as the rings represent 
the cells of decreasing time inten/als (in Figs. 8 and 10. the depth of a color is indicated with the thickness of a ring). 
In Fig. 8, data icons are not illustrated for the sake of explanation. In Fig. 8, reference numeral 60 denotes a display 
screen. A ring 61 lies at an outermost position in the display screen. The ring 61 is displayed in the deepest color. The 
ring 61 represents cell 10/6 of a day in Fig. 7. Rings 62a and 62b represents time bands of six hours (0:00-6:00 and 
so 6:00-1 2:00) and are displayed with lighter colors than the ring 61 . Rings 63a and 63b represent time bands of one hour 
(12:00-13:00 and 13:00-14:00) and are displayed with lighter colors than the rings 62a and 62b. Reference numeral 
64 denotes an area in which a time band represented by the outermost ring at that time (ring 61 in Fig. 8) is displayed. 
Owing to the foregoing display technique, a user can observe even a time band, in which data items are congested, 
for a sufficiently long period of time while recognizing a change between time intervals. 
SB Whether or not a cell should be subdivided is, as described in conjunction with Fig. 7, dependent largely on whether 

or not the number of data items belonging to tfie cell exceed a certain given value. The given value is equal to a 
maximum number of data icons that can be displayed on one ring. As shown in Fig. 3. in this embodiment, up to eight 
data icons are placed on one ring. The given value is therefore eight. 
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<Dala structure of a cell> 

Fig. 9 shews a data structure of acel! described in conjunction with Fig. 7. 

Reference numeral 70 denotes a whole list of cells. At the start of the cell list 70. there is a cell attribute field 71 

s containing attributes of -cells listed in the cell list 71. In the cell attribute field 71. cell levels 71-1 indicating levels of 
cells.are stored. The day-by-day cells in Fig. 7 are basic cells and of cell level 0. The cells representing a time band 
of six hours are of cell level 1. The cells representing a time band of one hour are of cell level 2. Reference nurr^eral 
71 -2 denotes cell units (lime inten/als). As for the cell units 71 -2. 24 hours is specified for the cells representing a day 
in Fig. 7. six hours is specified for the cells representing six hours, and one hour is specified for the cells representing 

w one hour. 71 -3 denotes the number of cells listed in the cell list 70. 71 -4 denotes ring colors used for depicting the cells 
in the form of rings. As for the ring colors 71-4. black is set for cell level 0 (V(0)=0). As the cell level increases, black 
is lightened according to V(N)={255-V(N-l)}/2. 71-5 denotes pointers each indicating a parent cell relative to a chiW 
cell. When a cell is of cell level 0, the cell has no parent. No pointer is specified for the cell. A pointer pointing out cell 
1 (72) is therefore specified as a child attribute in a childcell list 76. 

'5 In the cell list 70, the cell attribute field 71 is succeeded by cell fields 72a, 72b, 72c. etc. containing -cells listed in 

the cell list 70. At the start of each cell field: a start time and end time of the cell, and the number of data items belonging 
to the cod are specified. Each cell field includes a data list 73 in which data information concerning the data rtems 
belonging to the cell is retained. Each data 74 listed in the data list 73 consists of a data icon 74-1, data path name 
7--2 and data time 74-3. The data icon 74-1 is a bit-map innage 75a or a reduction of actual data. The data path name 

^0 7^-2 IS uscxj to reference a data file 75b residing in the disk. The data time 74-3 indicates a time instant at which the 
iUifi Lobiigs to the cell. In the file management system, the data time 74-3 is a date of creation of data or a date of 
cofrcct»on ol data. 

The number of data items may exceed a given value (a maximum number of data icons that can be placed on one 
(ing) When new data is added to a data list, therefore, the number of data items is checked. In the example of a display 

-s in Fig 3 wncn the number of data items exceeds eight, a cell concerned must be subdivided. For this subdivision, a 
child coH Ut\ is produced. The child cell list 76 has the same structure as the cell list described above. When the child 
cell list 76 IS produced, data items belonging to the cell are transferred to data lists preserved in child cell fields according 
lo the aula limes 74-3 of the data items, and thus deleted from the cell field 72a. That is to say, when a data list is 
preserved in a cell field, no child cell list is produced. When a child 5 cell list is presen/ed. no data list is present in the 

30 coll field A child cell attribute field contains values that are larger by one than cell levels specified in the cell attribute 
held and ring colors that are lighter than the ring colors specified therein. 

<Example of a display algorithm (initial display)> 

2S Next, a display algorithm for initial display will be described. 

(Example of a data structure for display management) 

Fig. 10 shows a data structure for display management. 
-io For zoom display, as apparent from an example of a display in Fig. 10, a ring is inched in 32 steps and drawn in 

units of eight steps. A display step list 80 lists sizes and positions of a ring at the respective steps, and sizes of tiata 
icons drawn on the ring. In the display step list 80, step information 81 a, 81b. etc. are stored in one-to-one correspond- 
ence to the 32 steps. 

Each step information includes a rectangle 82 (defined with coordinates (x1 , y1 ) of an upper left corner and coor- 
•^5 dinaies {x2, y2) of a lower right corner) inscribing the ring at each step. A data rectangle list 83 is also included. The 
size of the ring is expressed with an ellipse inscribed by a ring rectangle 82. The size of a data icon is expressed with 
a data rectangle that is specified in the data rectangle list 83 and that inscribes a data icon with the aspect ratio of the 
data icon unchanged. 

The number of data icons displayed on one ring is eight. The data rectangle list therefore lists eight data rectangles 
so for each of which size information including a display position is specified. The sizes of the ring at respective steps 
and the display sizes for data icons are set so that the data icons will become larger as the ring changes from a minimum 
ring to a maximum ring. The sizes are listed in a table so that the data icons can be noade larger linearly, nnade very 
large in the middle of zooming, or changed in any other way. Owing to such a table, sizes or positions need not be 
calculated in the middle of zooming. Therefore, displayed image moves smoothly. Therefore, displayed image moves 
ss smoothly. 
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(Retrieval of a cell corresponding to ah outemr^ost ring) 
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(Display algorithm) 
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from the screen. Drawing is therefore not executed, but control is passed to step S37. During the processing from step 
S32 to S41. alt rings and data icons that should be displayed are displayed. 

At step S42 and thereafter, processing for the next zoonning is carried out. At step S42. the step value is incrennented 
in units of the skip value. When the cursor lies on the center of a screen. 8 is specified as a skip vaiue. The step value 
is therefore incremented in units of 8. When the cursor lies on an edge, 1 is specified as a skip value. Steps are therefore 
skipped one by one. A user can therefore obsen/e data items at a desired zoom-in or-out speed according to how the 
data items appear. 11 the user wants to observe data items carefully, he/she should merely press a mouse button. An 
event invoking the processing described as the flowchart ct Fig. 1 3 will not occur. A display will therefore not be updated. 
The user can therefore observe the data items carefully. If it is found at step S43 that the step value is larger than or 
equal to 8, a residue after dividing the step value by 8 is specified for step at step S44. At step S45. the cell corresponding 
to the outermost ring is shifted to the next step. When the step value is smaller than 8, an event is waited. 

If the left mouse button is continually held down, the same event occurs imnnediately. The foregoing processing is 
repeated. 

(ii) 2oom-out 

Next, zoom-out will be described in terms of a difference from zoom-in. F ig. 1 4 is a flowchart-describing zoom-out. 
Basically, zoom-out is the reverse of zoomnDut. The processing from step S51 to S65 corresponds to the processing 
from step S32 to S44. A difference will be described below. 

If it is found at step S53 that (count X 8 + step) is larger than or equal to 32, the ring is too small lo be displayed. 
Control is passed to step S37. If (count X 8 + step) is smaller than 32, the (count X 6 + step)-th step information is 
retrieved at step S54. At step S65. the cell corresponding to the outermost ring Is used as a new cell for a preceding step. 

<Algorithm for data addition> 

Next, an algorithm for data addition will be described. Fig. 15 is a flowchart describing data addition. 

At step S70, when a data file has newly been created, a date of creation is retrieved. When a data file has been 
corrected, a date of correction is retrieved. At step S71 , the cell of the date is retrieved. For this retrieval, the sequence 
from step S2 to S7 in Fig. 11 is carried out. At step S72, the number of data items associated with the retrieved cell is 
checked to see if the number of data items is smaller than 8. 

When the number of data items is smaller than 8. control is passed to step S73. Calculation is performed to see 
how many display positions are empty. At step S74, a random number ranging from 0 to 9 is retrieved. For exanr^Jle, 
the low-order character of a second of a time at that time of operation is used as the random number Based on the 
random number, at step S75, the expression betow is calculated in order to find in which empty location data should 
be entered in. 

p = int(random number / 10 X number of empty places) 

Thus, data items are not stored in a data list consecutively from the top ot the data list but are entered at random 
in eight data locations in the data list. It is determined that the data listed at the top of the data list Is displayed first on 
a ring and then the subsequent data items are displayed on the ring clockwise. By contrast, if data items are always 
stored in the data list consecutively from the top thereof, many data items are displayed at specific display positions. 
A screen cannot be used efficiently. There Is a method for displaying data items at random position. Since a user may 
memorize a frequently-used data in relation to a display position, it is preferable that data display positions are fixed. 
For these reasons, the foregoing method is adopted. At step 877, empty data locatrans are traced in the data list. The 
data icon retrieved at step S76, path name of the data file, and data time are then written in the p-th-data kxation in 
the data list. 

When it is found at step S72 that the number ot data items is 8, the cell is full. A child cell field is therefore defined 
in the ceil field. At step S79, a child cell attribute field and child cell fields are defined. One data is retrieved Irom the 
parent cell field at step 380, and then inserted in a proper child cell field on the basis of a data time 74-3 of the data 
at step S81. At step S82, it is checked if the above processing is performed on all data items specified in a data list. 
When the processing has been performed on all data items, the data list is deleted from the parent cell field at step 
883. Control is then passed to step 871 . A new data file is then registered. 

In the aforesaid embodiment, an example of an operation focused on the operatbn of a file n^nagement system 
have been described. In this embodiment, an example ot an operation of schedule table software (scheduler) will be 
described. 

Fig. 16 shows an example of a scheduler. 

The schedule of the month Is displayed in a table form of acalendar with the heading on the center (700). When 
the schedule of a certain day is wanted to be checked in more detail or to be corrected, the day in the calendar Is 
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for instance, the root directory is defined to be of hierarchical depth 1 . Directories A, B, and C are of hierarchical depth 
2. Directory D is of hierarchical depth 3. Reference nunr^eral 604 denotes a level name. In the example of Fig. 18. A, 
B, C, Di Snd E are level names. 605 denotes the number of associated data items. For a hierarchical file browser, the 
number of associated data items equals to the number of files belonging to a directory. In the example of Fig. 18, the 
5 number ot data items belonging to directory A is 1, and the number of data items belonging to directory B is 2. 606 
denotes the number of levels subordinate to a level. In the example of Fig. 18, the number ot child levels subordinate 
to the root directory is 3. 

Reference numeral 607 denotes level display area information. An ar^a allocated according to the ratio of the 
number of associated data items including data items belonging to all child levels to the total number of data items is 

10 specified as the level display area information 607 by the level manager 502. 602 denotes data icon display area 
information. A data icon display area is determined according to the ratio of the number of data items belonging to a 
level to the total number ot data items all child levels and levels subordinate to the child levels. 608 denotes an asso- 
ciated data list. For data attribute data 609 concerning data items that betong to a level; that is, for a file browser, 
attribute data concerning files belonging to a directory is listed. 610 denotes a child level list. Level attribute data 601 

^5 concerning child levels that belong to a level is listed. 

(Example of data attribute data) 

Fig. 42 shows the structure of the data attribute data 609. 
20 In Fig. 42, reference numeral 611 denotes a data identifier for identifying data uniquely. 612 denotes a data name. 

In the example of Fig. IB. file names such A-1 and B-1 are data names. 613 denotes a data capacity indicating a data- 
occupied capacity ot a file system. 614 denotes a data type indicating an image format lor image data. 615 denotes 
an icon display size that is, as described later, determined by the level manager 1502 according to the number of data 
items belonging to a level. 616 denotes a data icon display position. 

2S 

(Examples of component elements of a display) 

Fig. 43 is an explanatory diagram concerning component elements of a display needed when the level display unit 
1502 displays data items belonging to a level according to data managed by the level managing module 1502 shown 
30 in Fig. 40. 

In Fig. 43, reference numeral 401 denotes a level display area in which data items belonging to a level or child 
levels are displayed. The same level display area is painted in the same background color. 402 denotes a border 
between a child level and a parent level. The bordermay be depicted explicitly with a line or expressed bydlflerentiating 
the background colors of level display areas. 403 denotes a level name display area. 404 denotes a data icon repre- 
3S senting the summary of data so as to identify the data. The component elements of the data icon 404 are varied 
depending on the type of data. For inniage'data. -the component elements are reduced image data and a data name. 
The component elements of data for a word processor are an icon inherent to an applrcation program, which indicates 
that data concerned is produced by the application program, and a data name. A data icon is structured in order to 
provide the summary of data. 

40 

<Example of a display of hierarchical data> 

Fig. 17 shows an example of a display of hierarchical data produced by the level display module 1503 according 
to data managed by the level managing module 1 502 in Fig. 40. Data to be displayed is the same as the data displayed 
by the file browser in Fig. 18; that is, data in the hierarchical file system. 

In Fig. 17, reference numeral 801 denotes a level display area for a root directory which is determined according 
to the level display area information 607. 802 denotes a level name display area in which a level name determined 
according to the level name 604 is displayed. 803 denotes a data icon representing file R-1 of which display size is 
determined according to the icon display size 615. 804 denotes a display area for directory A t^lat Is a child level of the 

50 root directory. 805 denotes a level name display area for directory A. 606 denotes a data icon representing file A-1 . 
607 denotes a level display area for directory B that is a child level of the root directory. 806 denotes a level name 
display area for directory B. 809 denotes a data icon representing file B-1. 810 denotes a data icon representing file 
B-2. 81 1 denotes a level display area for directory C that is a child Jevel of the root directory. 812 denotes a level name 
display area for directory C. 81 3 denotes a data icon representing file C-1. 814 denotes a level display area for directory 

55 D that is a child level of directory C. 815 denotes a level name display area for directory D. 816 denotes a data icon 
representing file D-1. 817 denotes a level display area for directory E that is a child level of directory C. 818 denotes 
a level name display area for directory E. 819 denotes a data icon representing file E-1. 820 denotes a data icon 
repf'esenling file E-2. 821 denotes a navigation cursor used to designate a marked level or marked data. 
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incremented by 1 at step Si 04 in Fig. 25. Control is then passed to step S105. If it is found at step S105 that the^t 
hierarchical depth exceeds the maximum hierarchical depth, level display area setting is terminated If the set hierar- 
chical depth does not exceed the maximum depth, control is passed to step SI 06. The aforesaid work is repeated for 
all hierarchical depths. Thus, all level display areas 607 and data icon display area information 620 shown in Fig. 41 
5 as well as all icon display sizes 61 5 and data icon display positions 616 shown in Fig. 42 are specified. 

(2oom-in or zoom-out) 

In this embodiment, when a detail of a desired level of hierarchical data is marked, a display is zoomed. Only the 
TO data items belonging to a desired level are then displayed. When a hierarchical structure extending below a desired 
level at a small hierarchical depth is nnarked, a display is zoomed out. Data items in a wide range can then be visualized 
with a view point set at the high level. 

Fig. 20 shows a zoomed-in display of directory C. In Fig. 17, the navigation cursor 821 Is pointed at any position 
except the child level display areas and data icons in the level display area 811 for directory C. The mouse button 304 
75 is then held down., The display is duly zoomed in, whereby the whole of a screen is, as shown in Fig. 20, occupied by 
the level display area for directory C. The data icons are enlarged in proportion to the zoom-in ratio. The more detailed 
information of each data icon can be acquired. 

The navigation cursor 821 is pointed at any position within the level display area 817 for directory E, and the mouse 
button 304 is held down. The level display area 81 7 for directory E is then zoomed in to occupy the wholescreen. Fig. 
20 21 shows a zoorned-in display of directory E. 

With the data icon representing file E-2 selected, the mouse button 304 is double-clicked ia double-ciick means 
in general that a mouse button is clicked twice lor a short period of time). The level display unit displays the detailed 
contents of file E-2. In Fig. 22. reference numeral 822 denotes an example of a display of the detailed contents of a file. 
By contrast, when a zoomed-in display of a low level is wanted to be changed to a display in which the low level 
25 , is viewed from a higher level, the display is zoomed out. Fig. 23 shows a zoomed-in display of directory E. In the display 
state shown in Fig. 23, when a given key (for example, a shift key) is pressed, the orientation of the navigation cursor 
821 is reversed and the navigation cursor 821 is oriented outward. In this state, when the mouse button 304 is held 
down, the display is zoomed out and the display shown in Fig. 20 appears (however, the navigation cursor 821 is 
oriented outward). When the mouse button 304 is still held down with the shift key pressed, the display is zoomed out 
^0 until the display shown in Fig. 17 appears. 

(Detailed infomaation display) 

In this embodiment, when a data icon representing desired data can be located without the necessity of zoom-in, 
35 detailed information display can be designated for the data using the navigation cursor 821 . Fig. 24 shows a method 
for directly designating detailed information display for data. For displaying the detailed infomnation of file E-2, as shown 
in Fig. 24, the data icon 820 representing file E-2 is designated directly using the navigatran cursor 821 . With a double- 
click, the detailed information shown in Fig. 22 can be acquired. 

40 (Hierarchical depth display) 

Fig. 37 shows an example of the hierarchical depth indicator 220 for indicating a hierarchical depth of a level 
corresponding to a level display area-zoomed in by a user. In Fig. 37, reference numeral 211 denotes the first hierar- 
chical depth zone. 211 denotes the second hierarchical depth zone. 213 denotes the third hierarchical depth zone. 

45 The number of zones indicating hierarchical depths is determined according toa maximum depth of a child level sub- 
ordinate to the level ot which display is currently zoomed in or a maximum depth of the level itself. For example, the 
maximum hierarchical depth of a level corresponding to a level display area is 3, the number of zones is 3. 208 denotes 
a hierarchical depth indicator icon that is displayed in a zone indicating a level of whrch zoomed-in display appears 
currently. The hierarchical depth indicator icon 208 is oriented in a direction, in which thet^ierarchrcal depth increases, 

so during zoom-in The hierarchical depth indicator icon 208 is oriented in a direction, in which the hierarchical depth 
decreases, during zoom-out. As for the method for indicating hierarchical depth zones, in an example of hierarchical 
depth indication shown in Fig. 37, as the hierarchical depth increases, the hierarchical depth zones are displayed with 
decreasing widths. Thus, the hierarchical depth zones are differentiated mutually. 

Fig. 38 shows another example of the hierarchical depth indicator 220. In the example of Fig. 38. hierarchical depth 

55 zones are painted in background colors of corresponding level display areas. Thus, the hierarchical depth zones are 
differentiated mutually. 

Figs. 33 to 36 show examples of screen displays of this embodiment having hierarchical depth indicators. Fig. 33 
shows an example of a display in. which a root level is displayed for level display In fig. 33. reference numeral 220 
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button is double-clicked, the detailed information 207 concerning the R&D manager is -displayed as shown in Fig. 32. 
[Third Embodiment] 

5 The third embodiment is concerned with another mode of the present invention. In displays and control flowcharts 

simitar to those described in the second embodiment, components having the same (unctions as those in the second 
embodiment are assigned the same reference numerals. The description of the components will be omitted. Compo- 
nents whose functions are different from those in the second embodiment will be described. 

10 (Data attribute data) 

Data attribute data 609 in this embodiment in Fig. 44 includes data items 622 to 625 shown under a dotted line in 
Fig. 44 in addition to the data attribute data in the second embodiment in Fig. 42, In Fig. 44, reference numeral 622 
denotes a data name display area size. 623 denotes a data name font size. 624 denotes an icon picture ID. 625 denotes 
IS an icon picture display flag. ■ 

(Example of a structure of a data icon) 

Fig. 45 is an explanatory diagram concerning component elements of a display of the data icon 404 shown in Fig. 43. 

20 In Fig, 45. reference numeral 701 denotes a display area for the whole of one data icon. The display area 701 has 

a shape of a rectangle defined with an origin (0,0) and coordinates {X^, Y^^) wherein Xj^ denotes a width of a data icon 
and denotes a height thereof, and has a size specified with an icon display size 6l 5 shown in Fig. 28. 702 denotes 
an icon picture display area in which an icon picture specified with an icon picture ID 624 shown in Fig. 28 is displayed. 
705 denotes an icon picture. Assuming that the width of an original of an icon picture is Wj^g and the height thereof 

2S is H|^„Q, the icon picture is enlarged or reduced to have a width W^^ and height Hj^ so that the icon picture can be 
fitted in the icon picture display area 702. 

Reference numeral 703 denotes a data name display area that is a rectangle defined with an origin (0, 0) and 
coordinates (Xj^, Yj) wherein Xj^ denotes a width and denotes a height, and has a size specified with a data name 
display area size 622 shown in Fig. 44. 704 denotes a data name display visualizing a data name 612 shown in Fig. 

30 44. When a whole data name 61 2 cannot be displayed in a data name display area 703. leading characters of the data 
name 612 are displayed by the number of characters that can be displayed. A symbol indicating that a data name 
continues is appended to the end of the characters. 

(Hierarchical data browser) 

3S 

Fig. 46 shows the detailed configuration of a hierarchical data browser 1 501 of this embodiment. Reference numeral 
740 denotes a data name display font size table that is referenced in order to set a font size for display of a data name 
612. 741 denotes a minimum data icon picture display size table that is referenced in order to set a minimum display 
area size for an icon picture needed to display the data icon 404 shown in Fig. 43. 

40 

(Example of a sequence for displaying a data icon) 

Fig. 47 is a flowchart describing a sequence for determining a data icon display formal according to the size of a 
display area for one data icon which is allocated as a result of step SI 25 in the flowchart of Fig, 30. Fig. 48 shows an 

45 example of a data name display font size table 740 shown in Fig. 46. A width W(k) of a data icon, height H(k) thereof, 
and font size Fs(k) are extracted relative to an index k. Fig. 49 shows an example of a minimum data icon picture 
display size table 714 shown in Fig. 46. A width V^irnmm height H^^^j^ indicating a minimum innage display area 
size are extracted relative to an index m determined according to an available memory <:apacity. 

A sequence of determining a data icon display format will be described in conjunction with the flowchart of Fig. 47. 

so In Fig. 47. at a step Si 60, the index k needed to access the data name display font size table 740 is initialized to 

0. At step Si 61 , the size of a data icon extracted from the data name display font size table 740 in Fig. 48 is compared 
with a size actually allocated to the data icon. It is assessed if XjcW(k) AND YicH(k) is established. If the relationship 
is not established, control is passed to step 81 62. The k value is incremented, and control is relumed to step ST61. 
This loop is executed repeatedly until the condition at step Sl61 is met. Thus, the k value is incremented repeatedly 

56 and then finalized. 

At step SI 63, a font size Fs(k) is extracted from the data name display font size table 740 in Fig. 48 and set as a 
data name font size 623 in Fig. 44. When the data name font size 623 is determined, a coordinate Y, defining a data 
name display area is determined with the height of a font, and set as a data name display size 622 in Fig. 44. In the 
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area allocated under the same condition as that in (a) of Fig. 59 is larger than that in (a) of Fig. 59. A frame larger than 
that in (a) of Fig; 50 is displayed as a data icon 404e. 

(c) of Fig. 59 shows an example of a display format used when the conditional expression k=1 AND (Yic-Yt<Hj^„in 
OR Xjc<Wj„mjn) is established. A data name is displayed with a font size tsl, and no icon picture is displayed. This 
s display is provided as a data icon 404f . (d) of Fig. 59 shows an example of a display format used when the conditional 
expression k=2 AND (Y,c-Y^<Hi^^j„ AND Xjc<W-,^mi„) is established. A data name 612 In Fig. 44 is displayed with a 
font size fs2, and-an icon picture is displayed. This display is provided as a data icon 404d. 

Fig. 60 shows an example in which when an available memory capacity is limited, the processing described in fig. 
47 is adapted to a sequence for displaying data icons in the course of displaying innage data categorized hierarchically 
TO In the form of a Venn diagram. 

In Fig. 60. category A is the highest level. Categories B. C, and D are levels going bwer in that order As the 
hierarchical depth increases, the size of a display area for one data icon decreases. For category A, data icons are 
displayed according to the format of a data icon 404d. For category B, data icons are displayed according to the format 
of a data icon 404c. For category C, data icons are displayed according to the format of a data icon 404b. For>category 
TS D, data icons are displayed according to the format of a data icon 404a. When category 8 is zoomed In, display areas 
allocated to data icons of category B are changed. A display format is determined for data icons in each level -display 
area according to the processing described with the flowchart of Fig. 47. 

(Grouping data icons) 

20 

Fig. 52 shows an example of a data display in a level display area for a certain level of a data base created by an 
insurance company for acquiring customer information. 

In Fig. 52, reference numeral 710 denotes' a level display area for a level of data A. 711 denotes a data icon 
representing portrait image data concerning person A. 71 2 denotes a data icon representing data concerning the house 

25 of person A. 713 denotes a data icon representing data corrcerning the health of person A. 714 denotes a data icon 
representing data concerning the property of person A. 715 denotes a data icon representing portrait image data 
concerning person B. 716 denotes a data icon representing image data concerning the house of person 8. 717'denotes 
a data icon representing data concerning the health of person B. 718 denotes a data icon representing data concerning 
the property of person B. When the number of data items is small all the data icons representing the data items can 

30 be arranged with a size extracted fronh Fig. 49. When the number of data items increases, the data icons must be 
made smaller or the display area must be made larger. Otherwise, alt the data Icons cannot be displayed. 

Figs. 53A to 53C are explanatory diagrams cone em in g a procedure for grouping' a plurality of data icons in a 
hierarchical data browser of this embodiment. 

Fig. 53A shows ah operation pfertormed by a user for grouping together the data icon representing data on the 

35 property of person A and the data icon 713 representing data on the health of person A. The navigation cursor 21 is 
used to select the data icon 713 representing data on the health of person A. The data icon 713 is then superposed 
on the data icon 714 representing data on the property of person A. Thus, the data icon 714 representing data on the 
property of person A and the data icon 71 3 representing data on the health of person A are grouped together. 

Fig. 53B shows a state in which the data icon 714 representing data on the property of person A and the data icon 

4C 713 representing data on the health of person A are grouped together and displayed as a group data icon 719. The 
group data icon 719 has a group mark 722 indicating that the data icon Is produced by grouping data icons together 
The foregoing operation is repeated for the data icon 712 representing image data on the house of. person A and 
the data icon 711 representing portrait image data on person A. As shown in Fig. 53C, tour data icons are grouped 
together and displayed as a group icon 720. An icon picture of a group icon displayed as a representative of the group 

45 represents icon picture data superposed last. The operation of grouping is not limited to the means for superposing 
one data icon on another. Alternatively, a grouping menu (GUI) may be provided tor helping a user select an instruction 
for grouping a plurality of preselected data icons together. 

Fig. 54 shows an example of a display in which four data icons set in array on an upper line in Fig. 52 are grouped 
together and four data icons set in array on a lower line in Fig. 52 are grouped together. 

so In Fig. 54, reference numeral 721 denotes a group icon produced by grouping together the data icon 715 repre- 

senting portrait image data on person B, the data icon 716 representing image data on the house ot person B, the data 
icon 717 representing data on the. health of person B, and the data icon 718 representing data on the property of person 
B. Thus, eight data icons are grouped into two icons. A larger number of data items can thus be managed or displayed 
without the necessity of reducing or enlarging the level display area 710. 

S£ When the navigation cursor 821 is pointed at the group nr^ark 722 shown in Fig. 54 and a mouse button is double- 

clicked, a data icon list 729 that is a list of data icons grouped together is displayed as shown in Fig. S5A. When the 
data icon 713 representing data on the health of person A is, as shown In Fig. S5B. designated using the navigation 
cursor 21 by double-clicking a mouse button, the detailed infornnat ran of data concerning the health of person A is 
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^-T:i;l.^eterencenu.era,.30denot.gro.^^^^^^^ 

group un?,uety. 739 denotes a ^'^^^^^^l^; Z:X:^^;':^T722 is designated by clicking a -use button^ 
ol date iter^s belonging to the group a e I'sted ^Vhen g^uP ^g^^ ,^,3 ^^^er .n which data 

data icons are displayed in the form oi the data .con l.st^29 shown n g ^ .^^^^.^.^^ 
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the largest:hierarchical depth is seen lying farthest. 

When a display area allocated to one data icon is large, an icon picture and data nanne are displayed with large 
sizes. When a. display area allocated to one data icon is small, an icon picture and data name are made small to such 
an extent that the icon picture and data name are discernible. When a display area allocated to one data icon is smaller, 
5 a data name is not displayed but an icon picture alone is displayed so that the data item represented by the data icon 
can be recognized. When a display area allocated to one data icon is much smaller, only the frame of the data icon is 
displayed so that the presence of the data item represented by the data icon can be recognized. Thus, data recognition 
is supported according to the size of a display area. 

When an available memory is small, it may be preprogrammed that unless an area allocated to one data icon has 
10 a certain size, the icon picture of the data icon is not displayed. This is effective in saving a memory capacity. 

A means is provided for grouping together a plurality of data icons representing data items and displaying them 
as a group icon. This enables, management of a large number of data items within a narrow display area. 

[Fourth Embodiment] 

75 

Fig. 61 shows an example of a display screen of album software of the fourth embodiment. 

As shown in Fig. 61, images are affixed to each page of an object looking like an album, and the images are 
accompanied by comments. In this album software, browsing in which pages are turned one by one is a basic operation 
for retrieval. A tree keyword that Is not shown can be appended to an image. In retrieval using the free keyword, a 
20 page containing an image concerned can be turned automatically. Reference numeral 920 denotes a slate in which 
an image is cut out according to this embodiment. In this example, a square is a frame. An image within the frame is 
visualized. This frame is registered in a palette window shown in Fig. 65. Any frame is selected from the palette window 
in order to cut out an image. 

2S <Example of the configuration of a picture management system> 

Fig. 39 shows an example of the configuration of a personal computer system sen/ing as a platform in which this 
embodiment is implemented. 

In Fig. 39. reference numeral 301 denotes a main unit o1 a computer system. 302 denotes a display for displaying 
30 data. 303 denotes a mouse typical of a pointing device. 304 denotes a mouse button. 305 denotes a keyboard. 

Fig. 75 shows the configuration of a hierarchical data nianagement system including software and hardware. 

In Fig. 75, similarly to Fig. 2. reference numeral 509 denotes hardware, 505 denotes an operating system <0S) 
operating oh the hardware 509. 504 denotes application software running under the OS 605. Some of blocks constituting 
the hardware 509 and OS 505 which are components but not needed directly in describing this embodiment are not 
35 illustrated. The unshown blocks constituting the hardware include a CPU and memory, and those constituting the OS 
include a memory management system. 

In Fig. 75, reference numeral-51 5 denotes a hard disk for physically storing files and data items. 508 denotes a 
file system constituting the OS. The file system 508 has the ability to enable application software to input or output a 
file without any awareness of the hardware. 514 denotes a disk I/O interface for allowing the file system 508 to read 
40 or write data from or in the hard disk 5 1 5. 507 denotes a drawing management systemconstituting the OS. The drawing 
management system 507 has the ability to enable applrcation software to perform drawing without any awareness of 
the hardware. 

Reference numeral 513 denotes a video interface for allowing the drawing nrmnagement system '507 to pertonm 
drawing on the display 302. 506 denotes an input device management system constituting the OS. The input device 
45 management system 506 has the ability to enable application software to receive a user input without any awareness 
of the hardware. 510 denotes a keyboard interface for allowing the input device management system 506 to receive 
an input from the keyboard 305. 512 denotes a mouse interface for allowing the input device management system 'SOe 
to receive an input from the mouse 303. 2502 denotes a frame managing module for registering or managing frame 
data in a palette. 2503 denotes a display module for displaying a cutout image by superposing frame data on an image. 

so 

< Example of a data structure> 
(Frame data) 

55 In Fig. 66, reference numeral 934 denotes frame data. 

The frame data is not bit-noap data but a set of functions expressing a straight line and curves. The frame data is 
standard data available under an OS. For example, Windows of Microsoft supports what is called a meta-file. A drawing 
facility included in the album software of this embodiment can create the meta-file. Drawing software that runs under 
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of a frame, control is passed to step S282. At step S2S2. it is checked if the position of the frame dragged from the 
palette window and then dropped is on an image. If the position is not on an image, the processing is terminated. 

When the position is on an image, the image data is retrieved at step S283. The frame data is retrieved at step 
S284. At step S285, image attribute data 930 associated with the image data, which is shown in Fig. 68, is created 
s newly. At step S286. a frame number 936 specified in the frame attribute data field 935 is copied as a frame number 

931 into the image attribute data field 930. Thus, a frame number is used to associate image data with frame data. 
At step S287. current position information and size information concerning the frame are stored as a frame position 

932 and frame size 933 respectively. At step S288, it is judged whether a re-sizing event occurs. If a frame re-sizing 
event occurs, control is passed to step S289. The image attribute data 930 is extracted from the image data. Control 

10 is then passed to step S287, and the current position and size are stored. When a re-sizing event does not occur, 
another event is handled at step S290. The processing is temninated. 

<Example of a sequence in this embodiment> 

?5 (Picture cutout) 

A sequence for selecting a frame tor an image from the palette, superposing the frame on the image, and then 
cutting cut the image will be described. First, an example of an operating procedure performed on an example of a 
screen shown in Figs. 72A and 72B will be described. 
20 As shown in Fig. 72A, a user selects any frame from the palette window, and drags and drops it on any image on 

an album page. The selected frame is then placed on the image with the size of the frame in palette window unchanged. 
A shown in Fig. 72B, part of the image inside a transparent area is still visible but part thereof outside the transparent 
area becomes invisible. 

The next user' operation is to re-sizing the frame to a desired size. First, The user presses a.nrK)Use button with a 
26 cursor on the frame, and drags the frame {moves the mouse with the mouse button held down) so that the center of 
the transparent area will align with the center of part of the picture that should be visible. 

As shown in Fig. 72B, a black square is displayed on an edge of a frame selected in the same manner as it is in 
general drawing software. The black square is dragged in order to re-size the frame. The re-sizing is achieved with 
the center of the transparent area fixed and the aspect ratio unchanged (equal enlargement sideways and lengthwise). 
30 whereby a frame is made larger or smaller as a whole In default re-sizing mode supported by drawing software or the 
like, the black square dragged by a user remains unchanged, while a square diagonal to the black square is fixed. For 
example, when a lower right corner of a square is dragged using the mouse, re-sizing is achieved with an upper left 
corner fixed (immobilized). This embodiment does not adopt this mode, because re-sizing performed with the center 
of a transparent area fixed is more suitable for fitting a picture in the transparent area. Thus, the operation is •carried 
36 out. The resultant state is indicated with reference numeral 920 in Fig. 61 . 

Fig. 74 is a flowchart describing a sequence for displaying an image cutout state relative to image data and frame 
data that are registered and managed. 

At step S300, an event is waited. When a display update event occurs, control is passed from step S301 o S302. 
The processing described below is then performed on all images to be displayed, or in other words, on. all images prior 
40 to an image display end. 

First, at step S303, it is checked if image attribute data associated with an image to be displayed is present. When 
image attribute data is present, a frame is superposed on the image. Control is therefore passed to step S304. At step 
S304, frame attnbute data 935 having the same frame number 936 as the frame number 931 specified in the image 
attribute data is retrieved. A transparent area 37 is retrieved at step S305. Based on the frame size 933 and transparent 
45 area 937, an area of the innage to be visualized (displayed) is defined at step S306. At step S31 0, the frame associated 
with the frame data is drawn at a frame position 932 with a frame size 933. With this processing, display ot a cutout 
state of an image is completed. 

If it is found at step S303 that no image attribute data is present, normal image display should be executed. All 
image data items are visualized at step S308. The processing is then completed. If it is found at step S301 that display 
so update is not designated, control is passed to step S309. Another event. is then handled, and the processing is termi- 
nated. 

(Overall operating procedure) 

55 Fig. 66 describes an overall operating procedure of this embodiment. 

At step S210. it is checked if a frame registered in the palette is used. If a frame registered in the palette is used, 
control is passed to step S211. A frame and a picture to be manipulated are selected. At step S212, a position and 
size of the frame are designated. Thus, the operating procedure is completed. Owing to the palette in which frames 
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(2oom-out) 

For changing a display state in which a low level is zoomed in into another state in which the low level is viewed 
Irom a higher level, the display is zoonned out. Fig. 78 shows a zoomed-in display ot directory E. When the right button 
B o1 the mouse 303 is pressed in the state of Fig. 78, the orientation of the navigation cursor 821 is changed outward. 
When the right button on the mouse 303 is held down, the display is zoomed out as shown in Figs. 76A to 76C (however, 
the navigation cursor 821 is oriented outward). When the right button is further held down, zoom-out continues to finally 
provide the display in Fig. 17. 

10 (Designating detailed information display) 

If a data icon representing desired data can be located without the necessity of zoom-in. the navigation cursor 821 
is used to directly designate detailed information display of data Fig. 79 shows a method for directly designating 
detailed information display of data. For displaying the detailed information concerning file E-2, as shown in Fig. 79, a 
75 data icon 20 representing file E-2 is designated with the navigation cursor 821 , and then a mouse button is double- 
clicked. Detailed information shown in Fig. 22 can then be displayed. 

(Zoom-in or panning sequence) 

20 Fig. 60 is a flowchart describing a sequence for zooming in or panning a given level. For zoom-out display, a zoom- 

in ratio is decremented at step S345. The description of zoom-out will therefore be. omitted. 

In Fig. 80, step S341 means that an event wait loop is entered. A designation (event) entered by a user at a mouse 
or keyboard is waited. When an event occurs, control is passed to step S342. It is checked if the user has designated 
a data icon by double-clicking a mouse button. II the result of checking is in the affirmative, control is passed to step 

2B S343. The detailed infonmation of data represented by the data icon is displayed. If the result of checking is in the 
negative, control is passed to step S344, It is checked if a mouse button 304 is pressed with the cursor at an edge of 
a screen, or in other words, which of zooming and panning is designated. If the result of checking is in the negative, 
zooming is designated. Control is therefore passed to step S345. If the result of checking is in the affirnriative, panning 
is designated. Control is passed to step S349. 

^0 For zooming, a zoom-in ratio is raised to a given ratio at step 5345. Control is then passed to step S346. When 

a position deviating from the center of a screen is designated for zoom-in. it is requested that the position should-come 
to the center ot a screen gradually in the course of zoom-in. At step S346, given shift values shiftX and shiftY are 
calculated according to a distance from a position at which the mouse button is pressed to the center of a screen. At 
step S347. the level display areas and data icon display areas for all levels, of which position and size information is 

3S retained, are updated. Specifically, the areas are enlarged at the Z,j ratio with respect to the center ot the screen, and 
the positions of the areas is shifted by the shiftX and shiftY values. Thus, new positions and sizes of the areas are 
determined. At step S348, an icon display size and data icon display position that are information representing a position 
and size of data icons are calculated for each data. The calculation is the same as the one of step S347. The calculations 
required for updating a display are thus completed. A display screen is then updated at step S352. 

-^0 For panning, given shift values shiftX and shiftY are set at step S349. At step S350, the level display areas and 

data icon display areas for all levels are shifted by the shiftX and shiftY values. At step S351. the data icon display 
positions are changed by the shiftX and shiftY values. The calculations required for updating a display are thus com- 
pleted. A display screen is then updated at step S352. 

<Exampleofachangeinsizeofadtsplay> 

Next, an example ot a technique tor making a display of a file relatively larger than any other file (data) according 
to the use frequency of the file (data) will be described in detail. 

Figs. 87A and 676 show examples of displays in this embodiment. 
50 In the stale of a display 1002 shown in Fig. 87 A, document E-1 is opened and used several times. With every use, 

the display of document E-1 becomes larger. After all the uses (accesses), the display looks like a display 1003. Doc- 
ument E-1 is displayed with a larger size, and other files (data) are displayed with relatively small sizes. 

Fig. 86 shows data attribute data in this embodiment. 

The data attribute data in Fig. 86 is the same as the one in Fig. 42 except that an access frequency 6161 and a 
55 date of record 61 62 are included additionally. The access frequency 6161 is incremented by one when the associated 
file (data) is designated with a double-click; that is, the file (data) is opened. -Based on the count value of an access 
frequency, the size of a display of data is determined by means of a technique to be described later. Some files (data 
items) may have been accessed frequently for a certain period of time but not been used thereafter When a file is 
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fig. 90. is a flowctiart describing a sequence tor dividing a level display area into a data icon display area and a 
child level display area. 

The sequence iri Fig. 90 corresponds to the one in Fig. 30. In Fig. 90. the sum of numbers of data itenns belonging 
to a level concerned and the total sum of numbers of data items belonging to all child levels are calculated. For the 

s calculation, the number o1 data whose access frequency 6161 is 0 shall be 1 .0 and the number of data whose access 
frequency is n shall be (1.0 + n x enlargement ratio). All the numbers are then added up (steps S1020 to S1025). 

If it is found at step S1023 thai certain data has an access frequency of 2 and an enlargement ratio of 0.2, the 
number of the data is calculated as 1 .0 + 2 x 0.2=1 .4. At step SI 027, a data icon display area ap^p Is defined according 
to a ratio of the sum of numbers of data items belonging to the level to the total sum of numbers of data items belonging 

fo to all the child levels. At step S1028, data icon display sizes 615 and data icon display positions 616 in Fig. 86 are 
determined. The display size is determined with a ratio proportional to an access frequency according to the same 
technique described at steps SI 020 to SI 025 in Fig. 90. The enlargement ratio f is a numerical value defined by default. 
The default value can be changed by. a user according to a use situation. 

Owing to the aforesaid techniques in Figs. 90 and 91, not only frequently-used data is displayed with a larger size 

7£ but also a level area containing the data is made relatively large In relation to other level areas. In Fig. 87B, when data 
E-1 is visualized with a larger size, a level area E containing the data E-1 and a level area C containing the level ar€a 
E are displayed with relatively targe sizes. Since a user has divided (categorized) data into level areas for a certain 
purpose, when certain data is accessed frequently, a category containing the data is used frequently. From this view- 
point, when frequently-accessed data is displayed with a larger size and thus highlighted, a category containing the 

20 data is displayed with a larger size. This is natural and rather preferable. 

(Example of enlargement display) 

This example is concerned with enlargement display. 

2B Enlargement displaying will be described, wherein a small raw image is enlarged and vignetted for displaying data 

designated using a cursor or belonging to a level subordinating a level for which a level area is displayed. For producing 
a detocused image, an image smaller than a raw image is averaged. A three-dimensional depth perception and a 
saving in occupied capacity of a memory can be attained at the same time. Thus, enlargement display is very effective. 
Fig. 92 shows an example of a display of this embodiment in a data base system handling mainly pictures. Fig. 

30 92 shows a process in which a user positions a cursor at an Image 2001 and zooms in the image. The image 2002 
belongs to a level immediately above the level of an image 2001 . The image 2002 is vignetted and displayed. Thus, 
an image belonging to a higher level than an image designated using a cursor can be seen closer than the image 
designated. This results in a display permitting a depth perception. At the same time, an image to be vignetted may 
be an image of a snnaller Image size. This leads to a saving In memory capacity 

35 Fig. 93 is a flowchart describing enlargement In this embodiment. 

When an event requesting display occurs at step S1031, a hierarchical depth of a position indicated by a cursor 
is extracted from a hierarchical depth identifier 603. The processing below is then executed for each of data items to 
be displayed At step 81034, a hierarchical depth Identifier associated with a level containing data Is retrieved. By 
comparing the hierarchical depth identifiers, it is judged which is higher; the level corresponding to a display area 

'^o containing the posltbn indicated by the cursor or the level containing the data. If the data belongs to a higher level, 
raw image data in a memory is replaced with data of a smaller size, and re-sizing (enlargement or reduction) is executed. 
Filtering is executed at step S1038. 

Fig. 94 shows a simple filter array. The center of the filter corresponds to a coefficient (1/2) to be applied to a 
marked pixel. A given coefficient (1/16) is applied to pixels surrounding the marked pixel. The multiplied pixel values 

45 are added up, whereby a vignetted display image is produced. The filler array in Fig. 94 may be varied depending on 
the size of a display image. During zoom-in, when an image to be seen tying closest is vignetted most intensely, a 
display offering a greater depth perception can be realized. For example, a filler array in Fig. 95 exerts a n>ore intense 
effect of vignetting than the one in Fig. 94. The filler in Fig. 95 is used for an image to be seen tying closes! (tor example, 
an image belonging to the highest level). Filters exerting weaker effects of vignetting are used step by step as a hier- 

50 archical depth increases. 

When it is determined at step SI 035 in Fig. 93 that the level containing the data is the same as or higher than the 
level corresponding to the display area containing the cursor position, normal re-sizing is executed. Display- related 
processing Is then executed at step Si 039. 

Owing to the foregoing sequence, a display in which an image designated using a cursor is In focus and an image 

SB seen tying close than the image is out of focus can be realized as if it were a scene viewed through a zoom lens of a 
camera. This embodiment has been described in terms of a data base consisting mainly of images. Aside from the 
data base, this embodiment can be Implemented in a file system, because the aforesaid processing should merely be 
executed for file icon images. 
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^Example ot time-orderly display> performed in order ot 

S are displayed at inward P««'»'°"^*'^,3f display located inward can fl'l^^l^'Zi^ can be enteredirom 

irsLo;F.a9e.re1erence^^^^^^^^^^^ 

,cons belongingto a ievel ^"^^^J^^l",^ , of the '^vel disp ^^^^^^^^^ a zoom-in ope-Btioa f ^ 

a time-orderly display icon 105^ appe^^^ jions the cursor on '\°"^°';,^jl'in side ot Fig. 96. When the 
,.„e-orderly display '-^^^^ .^^^^^^^^^^^ L time-orderly display ;];^XVn;rcente?o1 Fig. 97 to yet another one 

?rr.^.-— ^^^^ 

(Time rectangle attribute data) e^angle attribute data used to manage time rectangles in 

F,g. 102 ^ an explanatory diagram concerning '.me rectang 3 t.me rectangle identifier 

this embodiment. 108I denotes time rectangle attribute '^^^^^ . indicating a position in a 

' tn Fig. 102, reference numeral 108 deno. ^.^^ ^^^^^^^ .den mf , to^ ^^^^ .^^^ 

,or u^ique^ Kleotifyiog a tnte a time inten/al *"<l''=«';?„7,nmr n^^^^ ' 

depth direction 0I the time rectanglejC^* deno ^ ^^^^ '!^'I^Sea data list in which attnbute 

nulerot associated data -terr^^^^^^^^ 

:Lang.e disp^y area. ;0«"f^^X„h the time roc'^ngle; ^^^'^'^^02 is Identical to that in F.g. A2. 
data 609 concerning data ^^^^^^^ 0I the data attribute data 609 m h g 
a directory in a me browser IS I.ste0..n 

,Sett.ngthes.zeso,timerectang.esanddata.c«ns) ^^^^ ^nd data icons be.ong.ng to 

,,.eisa,.owchandesc.ingase.uencetorsett.ngthes..s ^ , 3.. 

Wh^aSser wants todisplaythe^^^^^^ 

a t,me interval trom the date 0I the o^e^^^^^^ J 3^3^. ,„ this e-'^^^fi .^Tue N is a value calcu^ted 
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The processing below is then executed tor each of the first to N-th time rectangles. At step S408. the size of a tinne 
rectangle currently handled is specified. The first time rectangle has the size of a display screen. The sizes of the 
subsequent time rectangles are determined by a means lor dividing an area which will be described later. When it is 
judged at step S409 that a file icon or time rectangle n+1 is associated with a time rectangle n. the area of the time 
5 rectangle n is divided into a file icon display area and a display area for the time rectangle n+l . The division is effected 
at a ratio of the number of file data items associated with the time rectangle n to the number of file data items associated 
with the time rectangle n+1 and subsequent rectangles. 

The resultant area of the lime rectangle n+1 is defined at step S408 through the next loop, and then further divided 
at step S410. The detail of step S410 will be described later in conjunction with Fig. 100. As a display shown in Fig. 
10 99A Is changed to a display shown in Fig. 99B, a time rectangle display area is defined and a file icon display area is 
defined within the time rectangle display area. Depending on an area ratio, a file icon display area for file icons asso- 
ciated with a time rectangle is defined as an outer area, and the next time rectangle area is defined as an inner area. 
The next time rectangle area is then divided into a file icon area and the next time rectangle area. Fig. 100 is a flowchart 
describing the detail of step 410 in Fig. 98. 

75 

(Dividing a display area) 

At step S320 in Fig. 1 00, a minimum display area a^j^ ^^^^ 'cons to be displayed in association with a currently- 
marked time rectangle is determined. First, the size of a data icon is predetermined by default according to the position 

20 of the time rectangle in a depth direction. The default size is set to the largest value for a data icon associated with the 
first (outermost) time rectangle and to the smallest value for a data icon associated with the last (innermost) time 
rectangle. An area, a^^, required for visualizing all data items associated with the time rectangle with the default size 
is then determined. The a^jg, value is calculated according to an expression a^^f^{{teiau\X data icon size + blank) X 
(number of data items associated with time rectangle)}. At step S321, a data icon display area a^,^ is detemnined 

2S according to a ratio of the number of data items associated with the time rectangle to the total number of data items 
associated with all the subsequent time rectangles. At step S322, the ap^p value is compared with the value. If 
the ap„p value is larger than or equal to the a^^^ value, the ap^p value is set as a data icon display area 1061 at step 
S323. Otherwise, the a^^j value is set as a data icon display area 1061 at step S324. 

At step S325, data icon display sizes 61.5 and data icon display positions 616 shown in Fig. 86 are determined. 

30 When the data icon display area 1061 in Figs. 99 A and 99B represents the a^et value, the data icon display size is set 
to a predetermined default value. When the data icon display area represents the ap^p value, the data icon display 
size is set to a value permitting all date icons contained with the data icon display area 1061 to be displayed. At step 
S326. an area remaining after removing the determined data icon display area is set as a display area for subsequent 
(inward) time rectangles. The flowchart of Fig. 100 corresponds to step S410 in Fig. 98. Thus, a data icon area, and 

35 sizes and positions of data icons are determined relative to time rectangles starting with the first time rectangle. 

(Zoom-in for time-orderfy display) 

Fig. 101 is a flowchart describing a zoom-in sequence for the aforesaid time-orderly display. In the time-orderly 
40 display, data icons are sorted by time in a depth direction. A panning facility is therefore not provided. For zoomout 

display, at step S 1 073, a zoom-in ratio is decremented. Since this step is the only difference from the zoom-In sequence, 

the description of the zoom-out sequence will be omitted. 

In Fig. 101, step S101 means that an event wait loop is entered. A designation (event) entered by a user at a 

mouse or keyboard is waited. When any event occurs, it is checked at step SI 072 if the user has designated a -data 
45 icon with a double-click. 11 the result of checking is in the affirmative, the detailed information of data represented by 

the data icon is displayed at step 81079 (the data is opened and displayed- If the result of -checking is In the negative. 

control is passed to step Si 073 lor zoom-in processing. A zoom-in ratio Zg is raised to a given value. The processing 

below is then performed for each of lime rectangles to be displayed. First, at step S1075. a time rectangle display area 

1086 and data icon display area 1087 in Fig. 102 are updated according to the value. For each of data icons 
so associated with the currently-marked time rectangle, an icon display size 615 and data icon display position 616 in 

Fig. 86 are calculated according to the Z^ value at step S1077. After the foregoing processing is performed for each 

of all the remaining time rectangles, a display screen is updated at step SI 078. 

(Navigation window) 

£5 

Fig. 84 shows a navigation window allowing a user to recognize which part of a hierarchical structure the user is 
looking at during zoomed-in display. The navigation window is composed of a display 2001 showing an xy plane ^plane 
defined with a height and width) and an indicator 2002 indicating a z-axis direction (depth direction). A current position 
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is indicated by cursors 2003 and 2004 in the xy plane display and 2-axis direction .indicator respectively. Either the 
cursor 2003 or 2004 is moved to any position in either the display 2001 or indicator 2002 by clicking a mouse button. 
This makes it possible to shift from the currently-visualized position to a desired position quickly. The xy plane display 
2001 shows the whole structure all the time. The display remains therefore unchar^ged except the cursor 2003. How- 
ever, the z-axis direction indicator 2002 is updated according to the hierarchical depth of a position visualized in the 
display screen 2005. 

The flowchart describing a sequence for creating the xy plane display 2001 is identical to the one shown in Fig. 
30. The sequence is carried out when this program is activated Fig. 81 is a flowchart describing a sequence for creating 
the 2-axis direction indicator. 

In Fig. 61, step S2010 means that an event wait \oop is entered. When it is judged at step S2011 that an event for 
reporting the fact that the display screen 2005 shown in Fig. 84 is updated occurs, control is passed to step S2012. 
Level attribute data 601 concerning a level indicated by a cursor in the display screen 2005 in Fig, 84 is then retrieved. 
At step S201 3, a hierarchical depth is extracted from a hierarchical depth indicator 603 specified in the level attribute 
data. At step S2014, the z-axis direction indicator 2002 in Fig. 84 is drawn according to the hierarchical depth. 

In the example 2002 in Fig. 84, the hierarchical depth is stepped in three. At step 52015 in Fig. 81. a current 
position in a depth direction is determined according to a ratio of the area of a display screen to a level display area 
607. The deierminatbn is based on the calculation shown in Fig. 82. Assume that a ralb of a display area tor a currently- 
marked level to a display screen in a state in which the display screen is zoomed out to the greatest extent so that all 
levels can be displayed in the display screen is "a," a ratio of the display area for the currently-marked level, which 
occupies the whole display screen, lo the display screen is;*b.' and a ratio of the display area for the currently-marked 
level to a current display screen is "c." The positron of the level can be calculated relative to the c value as follows: 

y= (n-1) X c/(c-1) - (n-1) x a/(b-a) 

where n denotes a hierarchical depth. When a display screen is zoomed out to the greatest extent (a), the z-axis 
direction indicator has a cursor positioned at a leftmost end as shown in Fig. 83A. The ratios are determined so that 
when a marked level occupies a whole screen, the cursor will come to an entry of a hierarchical depth indication step 
as shown in Fig. 83B. 

When the cursor in the navigation window is moved as mentioned above, a display screen is updated as described 
below. \A,'hen a movement in the z-axis direction is made (the cursor 2004 in Fig. 84 is moved), update is carried out 
as follows: the expression in Fig. 82 is calculated inversely using the position of the moved cursor in order lo work out 
an area ratio c' of a level display area to a display screen; cVa is calculated to work out a zoom-in ratio 2y in Fig. 80; 
and then the display screen is updated relative to the Zy value. When a movement on the xy plane is made (the cursor 
2003 in Fig. 84 is moved), update is carried out as follows: panning values shiftX and shiftY needed for panning as 
described in conjunction with Fig. 80 are worked out using a movement by which the cursor 2003 is moved, and then 
the whole screen is shifted by the panning values. 

As described so far, according to this embodiment, there can be provided an image editing method and system 
for making it possible to cut out an image and fetch it into album, software, or change cutouts by performing simple 
operations. 

There can also be provided an image editing method and system making it easy to grasp what a whole hierarchical 
structure is like or to locate an intended file. There can also be provided an image editing method and system making 
it easy to locate a frequently-used file from among numerous fites. 

This embodiment enables highly-flexible management of images and frames through registration of cutout forms 
(frames) in a palette. Any cutout form is selected from the palette, dragged and dropped irito an image, and enlarged 
or reduced with the center fixed. Thus, a simple and highly-flexible operating procedure can be provided. In the present 
invention, a raw image need not be manipulated or corrected but used as it is. It becomes easy to re-size a superposed 
frame or change frame data from one data to another. 

This embodiment enables visualization of a whole hierarchical structure of a file system or data base system by 
representing the interrelationship among levels and the interrelationship between levels and files (or data items) in the 
fomn of a nested hierarchy. When a desired level subordinate to any level is continually enlarged and displayed, the 
more detailed information concerning levels subordinate to or files (or data items) contained in the level can be acquired. 
By contrast, a means for continually reducing and displaying a level is used to provide information including information 
concerning higher levels. Screen update based on zoom-in or -out is achieved in proportion to a time interval during 
which a specific key on a keyboard or a pointing device is pressed. This results in a user interface enabling a user to 
manipulate a display sensuously 

A frequently-used file (data) is displayed with a relatively larger size than other files according to the use frequency 
The frequently-used file (data) can therefore be easily located. 

In a zoomed-in state, it is considered that a camera is focused on a level area for a level containing data designated 
with a cursor A display of data hems bebnging to a level subordinating the level are enlarged and vignetted. This 
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results in a three-dimensional depth perception and a saving in cxxupied capacity of a memory alike. 

Not onfy a hierarchical display mode but also a time-orderly display mode is available. By selecting either o1 them 
Ireely, time-orderly retrieval can be achieved concurrently with retrieval of hierarchicallysorted files (data items). Both 
of the modes can be realized by the same user interface that is zoom-in/out. The retrieving efficiency improves. 
5 When a hierarchical display is zoomed in greatly, a currently-marked position in a whole can be grasped easily 

owing to a window for displaying a position on an xy plane and a position in a z-axis direction. 

The present invention can be applied to a system constituted by a plurality of devices {e.g., host computer, interface, 
reader, printer) or to an apparatus comprising a single device. 

Further, as described above embodiments, the present invention can be also achieved by providing a storage 
10 medium storing program codes tor performing the atoresaid processes to a system or an apparatus, reading the pro- 
gram codes with a computer {e.g., CPU, MPU) of the system or apparatus from the storage medium, then executing 
the program. 

In this case, the program codes read from the storage medium realize the functions according to the embodiments, 
and the storage medium storing the program codes constitutes the invention. 
IS Further, the storage medium, such as a tbppy disk, a hard disk, an optical disk, a magneto-optical disk, CD-ROM, 

CD-R, a magnetic tape, a non-volatile type memory card, and ROK/I can be used for providing the program codes. 

Furthermore, besides atoresaid f u net bns according to the above embodiments are realized by executing the pro- 
gram codes which are read by a computer, the present invention includes a case where an OS or the like working on 
the computer performs a part or entire processes in accordance with designations of the program codes and realizes 
20 functions according to the above embodiments. 

Furthermore, the present invention also includes a case where, after the program codes read from the storage 
medium are written in a function extension board which is inserted into the computer or in a mennory provided in a 
function extension unit which is connected to the computer, CPU or the like contained in the function extension board 
or unit performs a part or entire process in accordance with designations of the program codes and realizes functions 
2S of the above embodiments. 

in a case where the present invention is applied to the atoresaid storage medium, the storage medium stores 
program codes corresponding to the flowcharts described in the embodiments. Briefly, the storage medium stores each 
module shown as an example of a mennory map in Fig. 103. More specifically, program codes which correspond to 
data (file) managing module, display managing module, memory managing module, input/output managing module, 
30 and data (file), and data (file) retrieving module, at least, are to be stored in the storage medium. 

The data (file) nr^naging module includes a hierarchical level management program, a date management program 
and a file (frame) managemerit program: The display managing module includes a hierarchical data display program 
and a cutout display program. 

The storage medium can also include files and/or data to be used for performing the present processes as well 
55 as program codes. 

The data or file area is separated into a file area and a data base area. The file area stores a hierarchical level 
list, a file list, attribute data and various tables. The data base area stores personal management data, schedule data 
and album data. 

The present invention may apply to a system composed of a plurality of equipment or an apparatus realized with 
40 one equipment- Needless to say, the present invention can apply to a mode in which a program is installed in a system 
or apparatus. 

The present invention provides a user interface for a computer to allow a user to more easily access data. The 
display of the data allows a user to locate and select data more easily. The data once selected can be used to carry 
out a predetermined operation such as output data to an output device such as a printer, or cause the modification of 
45 the display of data. 

Although preferred embodiments of the present invention have been described above, it should be understood 
that the present invention is not limited thereto and that other modifications will be apparent to those skilled in the art 
without departing from the scope o\ the claims. 

so 

Claims 

1. A linked data display method for displaying data items managed with given linkages thereamong. characterized 
in that: 

SB 

first data, and second data linked to said first data are displayed mutually distinguishably by determining sizes 
thereof according to a distance of a linkage. 
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2. 



10 



A .in.^ data d^p^y method according to Cai. t. wherein ^^J^'^^ '^^^'^^^ ^ ^'"^^"'^ 
stepped sl^es according to distances of linl^ges among a plurality of level,. 



Steps of; 



retrievina and displaying first data associated with a desired date. 



date. 
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area thereol made smaller. 

^ i ^i^im .whPrein a disDlav of each date is limited to a given number 
in units of a finer date and displayed distinguishably. 



larger. 
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smaller 

outermost position. 

date, and then displaying data items orderty in said graphics. 
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17. A time-series data display method according to claim 15. wherein said graphics such as rings or squares repre- 
senting dates associated with displays are displayed in different colors associated with said dates. 

18. A time-series data display method according to claim 16. wherein said data items are positioned in said graphics 
5 at random. 

19. A time-ssries data display method according to claim 18, wherein said random positions are specified at the time 
of data registration. 

10 20. A time-series data display method according to claim 5. wherein said accumulated time-series data items include 
data items accumulated in one-to-one correspondence to dates of creation of data files, data items accumulated 
in one-to-one correspondence to dates ot correction o1 files, and data items accumulated in one-to-one corre- 
spondence to designated dates registered by a user. 

is 21. A time-series data display method tor displaying accumulated time-series data items time-sequentially, comprising 
steps of: 

accumulating data items in one-to-one correspondence to dates of a schedule table; 
displaying said schedule table; and 
20 displaying data items associated with a desired date of said schedule table responsively to designation of said 

desired date. 

22. An information processing system for displaying accumulated time-series data items time-sequentially, comprising: 

2B an accumulating means for accumulating data items in one-to-one correspondence to dates; 

a retrieving means for retrieving data ot a desired date and data of a date contiguous to said desired date 
responsively to designation of said desired date; and 

a display means for displaying said. Retrieved data distinguishably in a tenrporal direction starting with said 
desired date. 

30 

23. An information processing system according to claim 22, wherein said display means displays a display screen 
for said data associated with a date contiguous to said desired date with a smaller size than a display screen for 
said data of said desired date according to an elapsed time. 

35 24. An information processing system according to claim 23. wherein said display means displays said data of said 
desired date at an outermost position in a display screen, and displays said data of a date contiguous to said 
desired date inside said data of said desired date with a display area therefore made smaller according to an 
elapsed time. 

40 25. An information processing system according to claim 22, wherein said display means includes a display limiting 
means tor limiting a display of each date to a given number of date items, and a display dividing means that when 
the number of data items exceeds said given number, classifies said data items in units of a finer date and displays 
said data items mutually distinguishably. 

45 26. An information processing system according to claim 25, wherein said accumulating means includes a subdividing 
and accumulating means for subdividing a data accumulatton unit into units of a finer date for fear the number of 
data items should exceed said given number, and then accumulating data items. 

27. An information processing system according to claim 24, further comprising a zoom designating means for use in 
so designating zoom-in or zoom-out for a screen display, and a zoom control means that when zoonrvin is designated, 

shifts the display positions of data items outward so as to increase the display areas thereof, and that when zoom- 
out is designated, shifts the display positions of data items inward so as to decrease the display areas thereof. 

28. An information processing system according to claim 27, wherein when zoom-in is designated, said zoom control 
ss means moves said dataof said desired date out of a display screen, retrieves new data associated with a dale 

contiguous to a date of data displayed at an innermost position, and displays said new data at said innermost 
position, and wherein when zoom-out is designated, said zoom control means moves said data displayed at said 
innermost position out of a display screen, retrieves newdata associated with adate contiguous to a-date of data 
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oi said desired date of said schedule table. 

icon size is decieased. -aiHHata 

. i^irr. -^7 wherem as said hierarchical depth increases, said data 
3B A hierarchical data display method according to c^.m 37, >«herem 

icons are simplilied more greatly. » determined 
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42. A hierarchical data display method according to claim 39, wherein as said hierarchical depth increases, said back- 
ground is displayed in a deeper color. 

43. A hierarchical data display method according to claim 36. further comprising a step of zooming in a desired level 
s by performing a given operation after designating a display area for said desired level. 

44. A hierarchical data display method according to claim 36, further comprising a step of displaying the detailed 
contents of a desired level by performing a given operation after designating a display area for said desired level. 

10 45. A hierarchical data display method according to claim 43, further comprising a step of zooming out a level zoomed 
by performing said given operation so as to display a parent level. 

46. A hierarchical data display method according to claim 36. further comprising a step of grouping a plurality of desired 
data icons, and displaying a leading data icon in such a way that it can be recognized that a plurality of desired 

'5 data icons are grouped together. 

47. A hierarchical data display method according to claim 46, further comprising a step of displaying a list of said 
plurality of data icons grouped together 

.-0 48. A tiicfcarchical data display method according to claim 46, further comprising a -step of rearranging a plurality of 
drtirt icons grouped together, a step of releasing a group, and a step of deleting a desired data icon from a plurality 
ol daUi icons grouped together 

49. A hierarchical data browser system for displaying hierarchically-managed data items, comprising: 

:s 

a display area dividing means for dividing a display area into an area, in which data icons representing data 

Items belonging to one level are displayed, and an area in which child levels are displayed; and 

a data icon display means for displaying said data icons with a size varied depending on a hierarchical depth. 

JO 50. A hierarchical data browser system according to claim 49, wherein said data icon display means decreases said 
Cfiia icon size as said hierarchical depth increases. 

51. A hierarchical data browser system according to claim 50, wherein said data icon display means simplifies said 
data icons more greatly as said hierarchical depth increases. 

3$ ■ 

52. A hierarchical data browser system according to claim 49, wherein said display area dividing means determines 
sizes of division areas on the basis of the number of data items belonging to one level and the nunr>ber of data 
items belonging to child levels. 

•^0 53. A hierarchical data browser system according to claim 49, wherein when there are a plurality of child levels, -said 
display area dividing means determines a display area for each child level on the basis of the number of data items 
belonging to levels subordinate to said child level. 

54. A hierarchical data browser system according to claim 49, wherein said data icon display means includes a back- 
45 ground display means for displaying data items belonging to the same level in the same background, said child 

levels are displayed in a background expressing a parent level, and said background is selected so that a hierar- 
chical depth can be distinguished. 

55. A hierarchical data browser system according to claim 54, wherein as said hierarchical depth increases, said 
so background is displayed in a deeper color 

56. A hierarchical data browser system according to claim 49, further comprising a zoom-in means for use in zooming 
in a desired level by performing a given operation after designating a display area for said desired level. 

S5 57. A hierarchical data browser system according to claim 49, further comprising a detailed contents display means 
for use in displaying the detailed contents of a desired level by perfonming a given operation after designating a 
display area for said desired level. 
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62. A hierarchical data browser system, comprising: . and 

. a hierarchical data rr^naging rr>eans lor ^^^^ing a P'^raJ^^^^ i^said hierarchical 

a level display means that based on '^^^^^^^^^^^^ belonging to one level and child levels are 

data managing means, delines an Jj/i^. j^ys saki area as an area having a background 

component elements, 
smaller than said minimum necessary area. 

so resutt of assessment. ™ri as 

Jo dine Whether or not to display an icon p.c,ore. 
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70. A hierarchical data browser system according to claim 69, further comprising a list display means tor use in dis- 
playing a list of data icons belonging to a group corresponding to a group icon by designating said group icon, and 
a detailed intormation display means for use in displaying detailed information of data -corresponding to a desired 
data icon selected from said list by designating said data icon. 

5 

71 . A hierarchical data browser system according to claim 69, further comprising a means for changing a representative 
picture of a plurality of data icons grouped together from one picture to another, a means for releasing a group, 
and a means for. deleting a desired data icon from a plurality of data icons grouped together. 

10 72. An image editing method for cutting out a designated area of an image in a given form,- comprising steps of: 

preparing a plurality of cutout forms; 

designating one of said cutout forms and placing it at a desired position in an image; 
changing said cutout fonm into a desired size; and 
IS outputting a portion of said image inside said cutout fonm as a cutout innage. 

73. An image editing method for cutting out a designated area of an image in a given form, comprising steps of: 

preparing a cutout form and image mutually independently with designating an identifier, position, and size of 
20 said cutout form as attributes of said image; 

when a registered cutout form is placed at a desired position in an image, if said cutout form Is enlarged or 
reduced to a desired size, registering said identifier of said cutout form, position, and size as attributes of said 
image; and 

outputting a portion of said image inside said cutout form as a cutout image according to said registered image 
2S attributes. 

74. An image editing method according to claim 72 or 73, wherein said cutout form is placed on the center of the 
portion of an image to be cut out, and then enlarged or reduced with the center position thereof fixed. 

30 75. An image editing method according to claim 74, wherein said cutout form is composed of a form used to cutting 
out an image and a form to be output as a perimeter of a cutout. 

76. An image editing method according to claim 72 or 73, wherein said cutout image is used as a Sumner image in a 
data base system. 

35 

77. An image editing method for a hierarchical data management system for managing a plurality of data items hier- 
archically, comprising steps of: 

registering an icon display size representing a size of an icon to be displayed and a data Icon display position 
^0 representing a display position for an icon as attributes of each data; and 

determining said icon display size and data icon display position in hierarchical order, and displaying data 
icons serving as data identification information with a size made different in hierarchical order so that data 
icons belonging to the same level can be distinguished from data icons beloiging to other levels. 

45 78. An image editing method according to claim 77, wherein a level or data icon is zoomed in, panned, or zoomed out 
by varying said icon display size and data icon display position. 

79. An image editing method according-to claim 77, wherein an access frequency meaning the number ot accesses 
gained to data is included in said data attributes, and a data icon representing data whose access frequency is 

50 relatively large is displayed with a relatively large size. 

80. An image editing method for a hierarchical data management system for managing a plurality of data Items hier- 
archically, comprising steps of: 

55 displaying data icons serving as data identification information with a size made different in hierarchical order; 

accessing data corresponding to a desired data icon by designating said desired data icon; and 
displaying a data icon representing data whose access frequency is relatively larger with a relatively larger size. 
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81 . An image editing method according to claim 79 or SO, wherein data icons belonging to the same level are displayed 
disttnguishably from data icons belonging to other levels, and a level containing data whose access frequency is 
relatively high is displayed with a relatively large size. 

82. An image editing method according to claim 79 or 80, wherein when said data icon displayed with a relatively large 
size is not accessed for a period of time exceeding a certain period, said data icon is reduced in proportion to said 
period during which said data icon is not accessed or an access frequency of another data. 

83. An image editing method according to claim 80, further comprising a step of zooming in. panning, or zooming out 
a desired level or data icon by designating said level or data icon. 

84. An image editing method according to claim 83, wherein a data icon belonging to a level subordinating a marked 
level is vignetted and displayed. 

85. An image editing method according to claim 84, wherein said vignetting is achieved by enlarging raw data repre- 
senting the number of pixels smaller than the number ot pixels to be displayed. 

An image editing method according to claim 85, wherein a data icon belonging to a higher level is vignetted more 
intensely. 

An >ndge editing method according to claim 77, wherein date information selected from among date information 
icprescnting a date of creation of data, date information representing a date of access gained to data, date infor- 
mation specified in data is included in said data attributes, said icon display size and data icon display position 
are determined date-orderly, and thus data icons serving as data identification information are displayed with a 
ci/c made different date-orderly so that data icons associated with the same date can be distinguished from data 
icons associated with other dates. 

88. An image editing method according to claim 87, wherein data icons associated with the same date are zoomed in 
or yoomed out by varying said icon display size and data icon display position. 

30 

89. An image editing method according to claim 67. wherein either said hierarchical display or date-orderly display 
can be selected. 



90. An image editing method according to claim 77, further comprising a step of displaying a position in a whole 
3S hierarchy, which is currently displayed in a screen, within a separate window in the form of a position on a plane 

defined with vertical and lateral lines and a position in a depth direction, and a step of displaying a desired level 
ai a desired enlargement ratio by designating a desired position within said separate window. 
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91. An image editing system for cutting out a designated area of an innage in given form, comprising: 
a registering means for registering a plurality of cutout forms; 

a situating means for use in designating one of said registered cutout foinns and placing it at a desired position 
in an image; 

a changing means for use in changing said cutout form into a desired size; and 
a cutout means tor outputting the portion ot said image inside said cutout form as a cutout image. 

92. An image editing system for cuning out a designated area of an image in given form, comprising: 

a registering means for registering a cutout form and image mutually independently; 

a situating means for use in situating a registered cutout form in an image by performing a given operation; 

a changing means for use in enlarging or reducing said cutout form to a desired size by perfonning a given 

operation; 

an attribute registering means for registering an identifier, position, and size of said cutout form as attributes 
of said image; and 

an image output means for outputting the portion of said image inside said cutout form as a cutout image 
according to said registered image attributes. 



93. An image editing system according to claim, 9l or 92, wherein said situating means aligns the center of said cutout 
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form with .the center of the portion of an image to be cut out. and said changing nneans enlarges or reduces said 
cutout form with the center thereof fixed. 

94. An image editing system according to claim 91 or 92, wherein said registering means registers said cutout form 
£ as a torm used to cut out a picture and a form to be output as a perimeter of a cutout. 

95. An image editing system according to claim 91 or 92, wherein said image editing system is included in a data base 
system, and said cutout image is used as a Sumner image. 

^o 96. An image editing system for a hierarchical data management system for managing a plurality of data items hier- 
archically, comprising: . 

an attribute registering means for registering an icon display size representing a size of an icon to be displayed 
and a data icon display position representing a display position for an icon as attributes of each data, and 
a first display means for determining said icon display size and data icon display positbn in hierarchical order, 
and thus displaying data icons serving as data identification information with a size made different in hierar- 
chical order so that data icons belonging to the same level can be distinguished from data icons belonging to 
other levels 

20 97. An image editing system according to claim 96, further comprising a first display changing means for zooming in, 
panning, or zooming out a level or data icon by varying said icon display size and data icon display position. 

98. An image editing system according to claim 96, further comprising^ second display changing means tor registering 
an access frequency meaning the number o1 accesses gained to data as an attribute of data, and displaying a 
data icon representing data whose access frequency is relatively high with a relatively large size. 

99. An image editing system for a hierarchical data management system tor managing a plurality ot data items hier- 
archically, comprising: 

a display means for displaying data icons serving as data identification information with a size varied in hier- 
archical order; 

an access means for use in accessing data corresponding to a desired data icon by designating said data 
icon; and 

a second display changing means for displaying a data icon representing data whose access frequency is 
relatively high with a relatively large size. 

100. An image editing system according to claim 98 or 9S, wherein said display. means displays data icons belonging 
to the same level distinguishably from data icons belonging to other levels, and said second display changing 
means displays a level containing data whose access frequency is relatively high with a relatively large size. 

40 

1 01 .An image editing system according to claim 98 or 99, wherein when said data icon displayed with a relatively large 
size is not accessed tor a period of time exceeding a certain period, said second display changing means reduces 
said data icon in proportion to said period during which said data icon is not accessed or an access frequency of 
another data. 

45 

1 02. An image editing system according to claim 99, further comprising a first display changing means for use in zooming 
in, panning, or zooming out a desired level or data icon by designating said level or data icon. 

lOa.An image editing system according to claim 102, wherein said first display changing means includes a vignetting 
50 means for vignetting and displaying data icons belonging to a level subordinating a marked level. 

104. An image editing system according to claim 102, wherein said vignetting means achieves vignetting by enlarging 
raw data representing the number of pixels smaller than the number of pixels to be displayed. 

55 lOS.An image editing system according to claim 104, wherein said vignetting means vignettes data icons belonging 
to a higher level more intensely and displays them. 

106. An image editing systeni according toctaim 96, wherein said attribute registering means registers date infornnation 
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.,in« a date 01 creation of data, date inlormation representing a date 
selected trom among date "•''^/^PI^J^^^^^^^^^ ^ Zl further comprising a second display means for 
of access gained to data, and date '"'^''"^''""^P^f ^„ '".^^Le-orde.ly, and thus displaying data icons serving 
°aeterminin'gsa.dicondispla^^andd3ta^^^^^^^^^^ 

, .^im 106 further corr^pr.sing a switching means for selecting erther said 
,0 i08.An image editing system according to cla.m 106, further CO p 

first display means or second display means. 

,OS.An image editing svstemaccordingtoc.ain,96, w^^^^^^^^^^^^ 

a Whole hierarchy, which ,s currently displayed in a ~ J^'*^" ^ direction, further comprising a display 
3 p^ne defined with vertical f j^l^^' 7/3^ ^.^^^^^^^^^^^^^^^ enlargement ca.io by designating a desired 
designating means for use in displaying a desireo leve 
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means for displaying hierarchically-managed data items, said computer program product including: 

compu'ter readable program code means tor dividing a display area into an area, in which data icons repre- 
senting data items belonging to one level are displayed, and an area in which child levels are dispiay-ed; and 
computer readable program code means for displaying said data icons with a size varied depending on a 
hierarchical depth. 

118. A computer program product according to claim 117, wherein said computer usable medium turther having a hi- 
erarchically-managed data. 

119. A computer program product comprising a computer usable medium having computer readable program code 
means for cutting out a designated area of an image in a given form, said computer program product including; 

computer readable program code means for designating one ot registered cutout forms and placing it at a 
desired position in an image; 

computer readable program code means for changing said cutout form into a desired size; and 

computer readable program code means for outputting a ponion ot said image inside said cutout lomn as a 

cutout image. 

20 120.A computer program product according to claim 119, wherein said computer usable medium further having a 
plurality of cutout forms and images to be cut out. 

121 .A computer program product comprising a computer usable medium having computer readable program code 
means for cutting out a designated area ot an image in a given form, said computer program product including: 

2S 

computer readable program code means for registering an identifier of a cutout form, and size as attributes 
of an image, if said cutout form is enlarged or reduced to a desired size, when a registered cutout form is 
placed at a desired position in said image; and 

computer readable program code nr^ans for outputting a portion ot said image inside said cutout form as a 
cutout image according to said registered image attributes. 

122. A computer program product according to claim 1 21 , wherein said computer usable medium turther having cutout 
forms and images mutually independently, with designating an identifier, position, and size of said cutout form as 
attributes of said image. 

35 

123. A computer program product connprising a computer usable medium having computer readable program code 
means for managing a plurality of data items hierarchically said computer program product including: 

computer readable program code means tor displaying data icons sending as data identification information 
with a size made different in hierarchical order; 

computer readable program code means tor accessing data corresponding to a desired data icon by desig- 
nating said desired data icon; and 

computer readable program code means for displaying a data icon representing data whose access frequency 
is relatively larger with a relatlvefy larger size. 
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124. A computer program product according to claim 123, wherein said computer usable medium further having a 
hierarchical data and an access frequency data. 

125. A user interface for a computer to allow a user to distinguish data items managed with different linkages therea- 
mong, the interface comprising a plurality of data display means for displaying a plurality of said data items mutually 
distinguishably by size, and means for determining the sizes ot said data items to be displayed according to dis- 
tances of the linkages. 

126. A method of interfacing a computer with a user to allow the user to distinguish data items managed with different 
linkages thereamong, the method comprising the steps of displaying a plurality of said data items mutually distin- 
guishably by determining sizes thereof according to distances of the linkages. 

127. A user interface for a computer to aitow a user to distinguish time series data items, the interface comprising 
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retrieving means tor retrieving a plurality o1 data items, a first data item being associated with a desired data and 
a second data item and any further data items being associated with a date temporally sequential to said desired 
date, and display means lor displaying said data items distinguishably from each other in a spatial sequence related 
to the tennporal sequence. 

128. A method of interfacing a computer with a user to allow the user to distinguish time series data items, the method 
comprising the steps of retrieving a plurality of data items, a first data item being associated with a desired data 
and the remaining data items being associated with dates temporally sequential to said desired data, and displaying 
said plurality of data items distinguishably from each other in a spatial sequence related to the temporal sequence. 

1 29. A storage medium storing instructions tor carrying out the method of any one of claims 1 to 21 . 36 to 48 or 72 to 90. 
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(57) The present invention provides a time-series 
data display method for displaying time-series data 
items so that a user can grasp time more intuitively and 
sensuously, and an information processing system for 
realizing the display method, wherein first data associ- 
ated with a desired date is retrieved and displayed, sec- 
ond data associated with a date contiguous to the de- 
sired date is retrieved, a display screen for the second 
data is displayed with a smaller size than a display 
screen for the first data in a temporal direction starting 
with the desired date, third data associated with a date 
contiguous to the date of the second data is retrieved, 
and the third data is displayed inside the second data 
with a display area thereof made smaller The present 
invention also provides a hierarchical data display meth- 
od and browser system, wherein a display area is divid- 
ed into an area, in which data icons representing data 
items belonging to one level are displayed, and an area 
in which child levels are displayed. As a hierarchical 
depth increases, the data icons are made smaller in size 
and simpler. The hierarchical structure of a file system 
or data base having a hierarchical structure can be dis- 
played in the form of a Venn diagram, thus nnaking it 
possible to grasp the whole structure intuitively. Data 
items belonging to child levels are not hidden but dis- 
played in the form of reduced images, whereby intended 
data can be located effortlessly. A cutout form and image 
are registered mutually independently. An identifier, po- 



sition, and size of the cutout form are specified as the 
attributes of the image. Thus, an image -can be fetched 
into album software by performing a sinrtple operation, 
or a cutout can be changed in size. 
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